215 questions
- Bountied 0
- Unanswered
- Frequent
- Score
- Trending
- Week
- Month
- Unanswered (my tags)
2
votes
0
answers
100
views
Using Prefect with FastAPI is still displaying old logs
I tried using Prefect with FastAPI project. Then when I updated logs and redeployed the repo as well as Prefect deployments and flows. It runs and displays the logs (Basically , Prefect is still ...
1
vote
0
answers
20
views
Setting Prefect flows and tasks to be robust to server outages?
I am working with a self hosted Prefect server.
I have tasks running both locally and on Fargate that are not triggered/initiated by prefect, but involve flows calling flows that call tasks.
If I have ...
0
votes
0
answers
37
views
How to run a subflow in a parent flow without creating another deployment
I have 2 flows: KPS flow and Compliance flow. Compliance would run after KPS, so I wrap them in a parent flow and create a deployment KPS & Compliance to schedule them to run together
However, I ...
0
votes
0
answers
188
views
Unable to start worker on prefect - httpx.connecterror: all connection attempts failed
I have started prefect server on Remote Desktop using
prefect server start —-host 0.0.0.0 —-port 8080
After this I am able to access the UI from different computers present on this network. I create a ...
0
votes
1
answer
206
views
Grafana Alloy no Prefect Pod Logs on Bottlerocket
In the Explore or Drilldown of Grafana, I can see Loki logs for different services, but when I tried to see prefect logs (the labels are preset in the filter), nothing is returned. I also tried to ...
1
vote
0
answers
171
views
In Prefect V3 how do I set the log level when running pytest
I'm struggling to suppress Prefect's internal logs during tests and would really appreciate any help.
No matter what I try, I keep seeing logs like:
17:23:20.248 | DEBUG | EventsWorkerThread | ...
0
votes
1
answer
467
views
Error when starting a Prefect worker: `PREFECT_API_URL` must be set to start a Worker
When starting a worker with the following command
prefect worker start --pool my-work-pool
I receive the following error:
ValueError: PREFECT_API_URL must be set to start a Worker.
An exception ...
0
votes
1
answer
49
views
How to avoid GKE evicts job pod and results in Prefect flow run failure?
We use Prefect (v3.0) in our data platform to orchestrate pipelines. We use GKE (Kubernetes) for Prefect workers and flow run deployment. Our GEK cluster is in auto scale (horizontal) mode.
In the ...
0
votes
1
answer
59
views
Prefect inside Github Codespaces: Can't Authorize Login
I'm trying to follow the Prefect Quickstart guide. I'm using a GitHub codespace. I was able to clone and
run 01_getting_started.py without trouble. however when I run step 3
uvx prefect-cloud deploy ...
0
votes
0
answers
100
views
How to dynamically create a Prefect deployment from a Git-sourced flow within a FastAPI endpoint?
We are trying to deploy a FastAPI endpoint, which calls a function to dynamically create a prefect deployment (sourced from git) but its failing.
Below is the code that is being used.
async def ...
0
votes
1
answer
171
views
Use anyc_playwright within multithreaded Prefect flow (`_channel` seems to be `None`)
I am having trouble using Playwright in my Prefect flow. The flow has to scrape ~800 urls and therefore splits them into chunks of 200 and runs those chunks in parallel. The urls within a chunk are ...
0
votes
1
answer
241
views
Prefect deployment triggered via API fails with FileNotFoundError: Missing directory, but directory exists
we have an api endpoint where a user makes a request from the api and it triggers prefect deployment using the deployment id
and gives the request to the deployed flow to process it
anytime it gets ...
-1
votes
1
answer
132
views
Prefect flows run one after another
I have two flows and for each of them a deployment. I want to run the second flow once the first one it's finished but when i run locally the deployments, i get the error 'Deployment not found'.
@flow
...
0
votes
0
answers
26
views
Prefect Erroneous whitelist message
I'm using Prefect Cloud on the free tier, which does not provide the allowlist feature.
If I use prefect cloud login then prefect cloud ip-allowlist ls on my local machine I get the message:
IP ...
0
votes
0
answers
115
views
SQLAlchemy multitenancy (shared table)
I am setting up a new multitenant application and wonder how to handle database access.
I am using a Postgres database. A Flask application is reading from the database. A Prefect job uses the same ...