Skip to main content
Stack Overflow
  1. About
  3. For Teams
Filter by
Sorted by
Tagged with
0 votes
0 answers
83 views

I have added a airflow_local_setting.py file to my mwaa s3 bucket at the root of dags folder. I have a dag_policy defined which is being picked up and works as expected. In the same file I have added ...
1 vote
0 answers
19 views

I have hundreds of jobs configured in postgresql metastore with their respective dependencies. I need to pull those jobs from metastore and execute them as per their dependency and track the status of ...
pkr's user avatar
  • 11
0 votes
0 answers
217 views

I updated my MWAA environment from 2.4.3 to 2.10.3 and I keep getting the following error randomly when i am executing multiple task at the same time: INFO - Task exited with return code -9. For more ...
Justin's user avatar
  • 121
0 votes
0 answers
68 views

I have a AWS MWAA Airflow. The Runs column, which shows data about the previous runs, keeps showing failures, marked in red circles, from many weeks/months ago and it is confusing. Everytime I open ...
0 votes
1 answer
100 views

I have a few DAGs that needs to run in a certain time that takes almost all the time-window it has to run before the next process is triggered. Adding the overhead of installing packages on every ...
1 vote
0 answers
51 views

I need to run scripts on Cloudera CDP. This needs to be done via MWAA(Managed Workspace for Apache Airflow) on AWS. Here are the details regarding MWAA environment: Airflow version 2.10.1 Python ...
0 votes
1 answer
368 views

I am using AWS MWAA with airflow version apache-airflow 2.8.1. I am getting this error: File "/usr/local/airflow/.local/lib/python3.11/site-packages/airflow/providers/amazon/aws/utils/...
2 votes
1 answer
208 views

I need to mount ~/.aws/credentials onto my docker container, and I have this semi-working but it's too permissive right now. I have some control over the docker container, but it is primarily managed ...
2 votes
2 answers
1k views

I'm deploying MWAA with Airflow version 2.10.1 on a non-public network, with the following requirements file: --find-links /usr/local/airflow/plugins --no-index pyarrow==14.0.2 filelock==3.15.4 ...
0 votes
0 answers
242 views

I am using Amazon Managed Workflows for Apache Airflow (MWAA) on AWS. I have an instance running and I am able to load DAGS on. I load the files to S3 and target the bucket and folder path to the DAGs,...
0 votes
1 answer
61 views

I am work in multi-tenant data pipeline platform. So, we have about 5 tenants for now. We use AWS MWAA (Apache Airflow) as orchestration tool. Each tenant has separate DAG and run serially in order to ...
0 votes
0 answers
121 views

Due to project security concerns, we were asked to upgrade the airflow version from 2.0.2 to 2.9.2 in AWS MWAA However while upgrading to 2.9.2, we are facing severe concerns and not even a single DBT ...
0 votes
1 answer
376 views

I am trying to create airflow env accross account; The subnets are in aws account1 and the env is in aws account2 .. (I am sharing the vpc in account2 with account1 using the subnets sharing) resource ...
0 votes
0 answers
118 views

I'm trying to create a new MWAA environment through CDK. I'm able to deploy the infrastructure, but the dags won't appear in the Airflow frontend. When I look at the dag processor manager logs I see ...
0 votes
1 answer
52 views

I added to my utils dir a new file that contains dict variable which I want to import into another file. mapping.py config = [ { "filter_column": "SHOW_NAME", &...
marcin2x4's user avatar
  • 1,509

15 30 50 per page
1
2 3 4 5
...
23

AltStyle によって変換されたページ (->オリジナル) /