1,237 questions
- Bountied 0
- Unanswered
- Frequent
- Score
- Trending
- Week
- Month
- Unanswered (my tags)
0
votes
0
answers
49
views
Customized executor in mesos does not work?
I try to implement a customized executor in mesos which is the simplest example but it seems the process being launched gets killed by the mesos agent. the error info i got is as below
I0103 16:46:27....
1
vote
0
answers
33
views
How to run a local python script with spark on mesos in cluster mode
I want to run a local python script with spark on mesos.
My master use a mesos dispatcher to install a spark framework.
./start-mesos-dispatcher.sh --master mesos://master:5050
Then I use spark-...
2
votes
1
answer
315
views
Failed to find a mounted cgroups hierarchy for the 'cpu' subsystem; you probably need to mount cgroups manually on MacOS Sonoma 14.3.1
I am trying to run a mesos-slave container on MacOS with an ARM64 architecture. Since there is no native ARM64 Docker image for mesos-slave on dockerhub, I have to build my image with a base centos7 ...
0
votes
1
answer
50
views
deregistered instance showing unreachable in mesos , how to clear this?
i am using mesos-marathon cluster for my setup and i have 40 instances registered with mesos .
i want to remove 1 instance from the cluster. To do that , i just stopped that ec2 instance and reduce ...
1
vote
1
answer
601
views
Configuring a self hosted GitLab-CE CI/CD server in parallel with a GitHub Team account
I am looking to perform code reviews as part of a trunk based development approach with my backend team on a self hosted gitlab server. I also wish to use it to deploy to internally hosted ...
0
votes
1
answer
79
views
How to set log level in chronos
I'm trying to change the loglevel in chronos from the default INFO to TRACE. I have gone through the docs and they seem to be outdated as per this issue.
I have done a local setup using docker but to ...
0
votes
0
answers
149
views
configure: error: Mesos requires Python < 3.0
I want to install Mesos on Oracle Linux 8.3 which does not have Internet access. I followed the process exactly in its site in part CentOS 7.1 and installed some packages before building mesos. I ...
M_Gh's user avatar
- 1,172
1
vote
0
answers
2k
views
Exception in thread "main" org.apache.spark.SparkException: Driver cores must be a positive number
I have problem with submit task in Mesos with cluster mode, first I using this syntax to running cluster mode on Mesos
$ cd spark
$ ./sbin/start-mesos-dispatcher.sh --master mesos://10.2.3.95:5050
...
0
votes
0
answers
67
views
Task/Job Failed on Mesos
enter image description here
Anyone know why every task/job that I run using spark submit on my apache Mesos cluster is always STATE FAILED? For your information, I using spark mesos dispatcher to run ...
0
votes
1
answer
75
views
Integrating hadoop yarn with mesos infra
I have created a hdfs cluster . I have to configure yarn so as to allow yarn application master to be able to create containers for job processing on the mesos cluster on demand .
how can i integrate ...
1
vote
1
answer
79
views
Once tasks are finished does Mesos Agent kill the Mesos Executor that was running the tasks or does the Mesos Executor persist to receive new tasks?
I'm trying to better understand when Mesos Executors are killed by Mesos Agents once tasks that are running in the Mesos Executors finish. Does the Mesos Agent automatically kill Mesos Executors if ...
2
votes
1
answer
385
views
Where can I find binary packages for Apache Mesos?
I have been trying to install mesos on my VM. To be specific on Ubuntu Focal Fossa. However, I googled this and didn't saw any repository/binary packages for mesos. Can someone help me with this?
I ...
0
votes
1
answer
27
views
Standalone mesos master behind load balancer EC2
I have a mesos master behind a load balancer and a mesos agent that tries to connect to the mesos master via the load balancer
Everything is good when the agent directly connects to the master by ...
ffff's user avatar
- 3,080
0
votes
1
answer
199
views
I wonder why many resource managers (Yarn, Mesos, Kubernetes etc.) do not support setting the disk I/O resource usage of containers
In most resource managers, we can set the container's CPU usage and memory usage.
But I'm curious about the technical reasons for not supporting disk I/O resource allocation for containers.
2
votes
1
answer
283
views
Is Celery a "real" scheduler like PBS, MESOS or YARN?
I have an existing application that is using Celery.
Clients submit tasks to Celery, and Celery's workers unstack those tasks and run it, accross different physical hosts.
Each Celery worker run a ...