873 questions
- Bountied 0
- Unanswered
- Frequent
- Score
- Trending
- Week
- Month
- Unanswered (my tags)
0
votes
0
answers
39
views
Cloud Build no longer authenticates gsutil using service account
I have a Dockerfile that builds an image based on golang:bookworm. It installs the google-cloud-cli package from the https://packages.cloud.google.com/apt repository. I used it to build an image that'...
1
vote
2
answers
111
views
Date Comparison in UNIX Shell Script failing
I am trying to extract the file date from the output of a gsutil ls -l command and compare it to other dates. However, the comparison appears to be not working.
lstr=$(gsutil ls -l gs://input-bucket/...
0
votes
0
answers
54
views
How to extract first n rows of a .tsv.bgz file with gsutil?
How to extract the first n rows of a block compressed tab-separated value text file (.tsv.bgz), which could only be accessed with gsutil, into a text file? The original file is very large, so I wonder ...
0
votes
1
answer
83
views
How to preserve only timestamp and mode of the file, an not other posix metadata when using "gcloud storage" command line interface?
When I use -P options with
gcloud storage cp -r -P gs://some/bucket/object ./
It tries to convert the user id also and fails with the following message
ERROR: Root permissions required to set UID ...
0
votes
1
answer
92
views
in MacOS and it pre-compiled version of crcmod not being detected
➜ datasets gsutil --version
gsutil version: 5.27
checksum: 5cf9fcad0f47bc86542d009bbe69f297 (OK)
boto version: 2.49.0
python version: 3.10.13 | packaged by conda-forge | (main, Dec 23 2023, 15:35:25) ...
2
votes
1
answer
1k
views
Firebase-Storage Access to fetch at '..' has been blocked by CORS policy: No 'Access-Control-Allow-Origin' header is present on the requested resource
I am tying to load an image using the following code:
const blob = await fetch(
"https://firebasestorage.googleapis.com/...?alt=media"
)
.then((r) => r.blob())
const reader = ...
0
votes
1
answer
125
views
AccessDeniedException when trying to delete a file from Google Cloud Storage despite having Storage Admin role
I am facing an AccessDeniedException (403 Access Denied) when trying to delete a file from a Google Cloud Storage bucket. I have assigned the necessary permissions and roles (Storage Admin), but I ...
1
vote
2
answers
253
views
How can I check that .gcloudignore in GC bucket works properly?
I wanted to exclude some of the files while pushing files to the GC storage. I created .gcloudignore in a root of my bucket. I enabled the .gcloudignore through the command: gcloud config set ...
1
vote
0
answers
240
views
How to download multiple files from Google Cloud Storage bucket and save each into its separate folder
I'm trying to download a batch of about 50 files from a Google Cloud Storage bucket. I have a bucket that contains multiple files. I can search and filter using the user interface until I have the ...
1
vote
0
answers
52
views
How to transfer file from someone else's gscloud bucket to google collab/python?
I have access rights to only a part of a google cloud bucket of another person. I can download the files from there to my desktop using terminal or using the bang(!) operator to get the files in my ...
0
votes
1
answer
167
views
Google Cloud Storage Signed URL not Accessible in HTML but Works in Browser
`I'm using Python with the Google Cloud Storage library to generate signed URLs for my objects in a bucket. These URLs are meant to be embedded in HTML to display images on a webpage. However, while ...
0
votes
1
answer
106
views
Error in executing gcloud commands in bash script in crontab
I have written a bash script that uses
gcloud command to activate service account and
gsutil command to move files to GCS bucket.
When I run the script using bash command, it executes well.But when I ...
3
votes
2
answers
3k
views
gcloud storage cp is not working for larger files
I am trying to use gcloud storage cp command for copying large files to gcp bucket. The command is working fine for smaller files. But it gives permission issue for larger files.
gcloud storage cp ...
1
vote
2
answers
316
views
IPython installation on Mac
I have uninstalled Anaconda on Mac and am now trying to install IPython using pip3.
When I try to install IPython, I get a prompt, "User for us-central1-python.pkg.dev: ". This asks for ...
0
votes
1
answer
267
views
Unable to download data from Google Cloud Storage to local directory using Google Cloud SDK Shell
Up until a year ago I was able to download folders and directories from my bucket on Google Cloud Storage, now I keep getting errors when I try to download using the same commands that previously ...