50,926 questions
- Bountied 0
- Unanswered
- Frequent
- Score
- Trending
- Week
- Month
- Unanswered (my tags)
3
votes
1
answer
40
views
How do I delete all the versions of the S3 object using AWS Node.js SDK?
I have versioning enabled bucket and need to delete multiple objects and their versions. I am referring to this guide which lacks Node.js example. This is my current code which only works for non-...
0
votes
0
answers
9
views
Why does Milvus fail with "fs == nullptr" when loading large HNSW indexes from S3 storage?
I’m running into a fatal error when loading a large HNSW index in Milvus 2.6.7, deployed via Docker, and backed by S3-compatible object storage.
Here is the setup:
Collection size: ~50 million ...
1
vote
1
answer
56
views
AWS Glue PySpark job taking 4 hours to process small JSON files from S3
I have an AWS Glue job that processes thousands of small JSON files from S3 (historical data load for Adobe Experience Platform). The job is taking approximately 4 hours to complete, which is ...
0
votes
0
answers
47
views
AWS SDK v4 and S3 GetObject - System.Net.WebException: The underlying connection was closed: An unexpected error occurred on a send
I'm trying to figure out the source of this issue so I have created a little sample C# app that uses the AWS SDK v4. It calls out to an s3 bucket to get a file, the same file, in a loop.
Here's a ...
0
votes
0
answers
67
views
Multipart uploading with s3/lib-storage failed after updating from v3.712 to v3.948
My multipart uploading service for my website (using Angular) failed immediately after updating s3/lib-storage from v3.7xx to vc.9xx. This service has failed before when updating to v3.8xx, so I ...
1
vote
1
answer
120
views
Presigned URL for S3 - Check your key and signing method
I am trying to get an object from my S3 bucket using pre-signed URLs (from the AWS docs):
import boto3
from botocore.config import Config
from botocore.exceptions import ClientError
def ...
-3
votes
1
answer
114
views
Localstack Terraform S3 creation error of Error: listing tags for S3 (Simple Storage) Bucket [closed]
I am trying to create a S3 bucket on LocalStack using Terraform and when I copied the code from their documentation it is giving me this error. I am unable to solve this terraform error.
main.tf:
...
0
votes
0
answers
71
views
AWS Bedrock Data Automation (BDA) – InvokeDataAutomationAsync returns "Data automation project does not exist"
I am trying to invoke an Amazon Bedrock Data Automation (BDA) project asynchronously to extract structured data from a PDF stored in S3. I am able to successfully create, list, and retrieve the BDA ...
Best practices
0
votes
3
replies
67
views
Next.js + S3-compatible storage: presigned uploads from browser vs uploading files to API route
I’m building a page builder in Next.js (App Router) where users upload images that are stored in DigitalOcean Spaces (S3-compatible).
Depending on the page:
some flows upload a single image (e.g. ...
0
votes
0
answers
44
views
Radosgw didn't apply LUA (tiering - ceph)
I'am new to S3 and I'm trying to apply LUA script to manage object via storage class in radosgw and this is what came out in radosgw logs by using this command "s3cmd put ti s3://totodash". (...
Best practices
0
votes
2
replies
27
views
Lifecycle Deleted files not being cleaned up
I have a bucket that has versioning turned on.
I want to clean up deleted files after 1 year.
Scope is entire bucket
But for some reason some deleted files aren't removed even though they were ...
0
votes
1
answer
47
views
AWS S3 pre-signed URL upload is returning 200 OK but the file never appeared in the bucket
Using Node.js and Express.js, I am generating an AWS S3 pre-signed upload URL.The request to S3 returns 200 OK but the uploaded file file never appeared in the bucket.
There is no error in AWS console....
0
votes
0
answers
77
views
Parsed CSV rows are coming through as Buffers instead of arrays when loading files from S3
I'm pulling multiple CSV files from S3. Each CSV contains several rows in this format:
45,ABC,800046,HJN,9000
The first column is the employee ID.
I want to loop through all the files, parse each CSV, ...
0
votes
1
answer
65
views
Trino Select from public aws S3 storage anonymously (hive connector)
My hive connector config, hive_aws.properties:
connector.name=hive
hive.metastore.uri=thrift://hive-metastore:9083
fs.native-s3.enabled=true
s3.endpoint=https://s3.amazonaws.com
s3.region=us-east-1
(...
0
votes
1
answer
47
views
Why does CopyObject fail with "Header 'x-amz-tagging-directive' with value 'REPLACE' not implemented" for Cloudflare R2?
I'm trying to rename an object in an S3-compatible storage by copying it to a new key and then deleting the old one in Cloudflare R2. I'm using AWSSDK.S3 (4.0.13.1)
private (bool success, string ...