I have successfully deployed a spring boot application deployed in google cloud app engine flex environment on May 20, 2025. I tried to deploy same version of the application without any success on May 21, 2025. Following are the logs
Updating service [my-agent] (this may take several minutes)...⠹DEBUG: Operation [apps/my-proj-prod/operations/f1b60017-ba71-4988-8854-2b2222ec6dee] complete. Result: {
"done": true,
"error": {
"code": 4,
"message": "An internal error occurred while processing task /app-engine-flex/flex_await_healthy/flex_await_healthy>2025年05月22日T05:55:45.336Z148159.jc.0: Timed out waiting for the app infrastructure to become healthy."
},
"metadata": {
"@type": "type.googleapis.com/google.appengine.v1.OperationMetadataV1",
"createVersionMetadata": {
"cloudBuildId": "52c676c3-4319-4a6f-9eed-84fb44737a31"
},
"insertTime": "2025年05月22日T05:50:43.734Z",
"method": "google.appengine.v1.Versions.CreateVersion",
"target": "apps/my-proj-prod/services/my-agent/versions/20250521t235039",
"user": "[email protected]"
},
"name": "apps/my-proj-prod/operations/f1b60017-ba71-4988-8854-2b2222ec6dee"
}
Updating service [my-agent] (this may take several minutes)...failed.
DEBUG: (gcloud.app.deploy) Error Response: [4] An internal error occurred while processing task /app-engine-flex/flex_await_healthy/flex_await_healthy>2025年05月22日T05:55:45.336Z148159.jc.0: Timed out waiting for the app infrastructure to become healthy.
Traceback (most recent call last):
File "/home/user-1/tools/google-cloud-sdk-352.0.0-linux-x86_64/google-cloud-sdk/lib/googlecloudsdk/calliope/cli.py", line 987, in Execute
resources = calliope_command.Run(cli=self, args=args)
File "/home/user-1/tools/google-cloud-sdk-352.0.0-linux-x86_64/google-cloud-sdk/lib/googlecloudsdk/calliope/backend.py", line 809, in Run
resources = command_instance.Run(args)
File "/home/user-1/tools/google-cloud-sdk-352.0.0-linux-x86_64/google-cloud-sdk/lib/surface/app/deploy.py", line 127, in Run
return deploy_util.RunDeploy(
File "/home/user-1/tools/google-cloud-sdk-352.0.0-linux-x86_64/google-cloud-sdk/lib/googlecloudsdk/command_lib/app/deploy_util.py", line 692, in RunDeploy
deployer.Deploy(
File "/home/user-1/tools/google-cloud-sdk-352.0.0-linux-x86_64/google-cloud-sdk/lib/googlecloudsdk/command_lib/app/deploy_util.py", line 471, in Deploy
self.api_client.DeployService(new_version.service, new_version.id,
File "/home/user-1/tools/google-cloud-sdk-352.0.0-linux-x86_64/google-cloud-sdk/lib/googlecloudsdk/api_lib/app/appengine_api_client.py", line 230, in DeployService
return operations_util.WaitForOperation(
File "/home/user-1/tools/google-cloud-sdk-352.0.0-linux-x86_64/google-cloud-sdk/lib/googlecloudsdk/api_lib/app/operations_util.py", line 307, in WaitForOperation
completed_operation = waiter.WaitFor(
File "/home/user-1/tools/google-cloud-sdk-352.0.0-linux-x86_64/google-cloud-sdk/lib/googlecloudsdk/api_lib/util/waiter.py", line 261, in WaitFor
operation = PollUntilDone(
File "/home/user-1/tools/google-cloud-sdk-352.0.0-linux-x86_64/google-cloud-sdk/lib/googlecloudsdk/api_lib/util/waiter.py", line 322, in PollUntilDone
operation = retryer.RetryOnResult(
File "/home/user-1/tools/google-cloud-sdk-352.0.0-linux-x86_64/google-cloud-sdk/lib/googlecloudsdk/core/util/retry.py", line 249, in RetryOnResult
if not should_retry(result, state):
File "/home/user-1/tools/google-cloud-sdk-352.0.0-linux-x86_64/google-cloud-sdk/lib/googlecloudsdk/api_lib/util/waiter.py", line 320, in _IsNotDone
return not poller.IsDone(operation)
File "/home/user-1/tools/google-cloud-sdk-352.0.0-linux-x86_64/google-cloud-sdk/lib/googlecloudsdk/api_lib/app/operations_util.py", line 182, in IsDone
raise OperationError(requests.ExtractErrorMessage(
googlecloudsdk.api_lib.app.operations_util.OperationError: Error Response: [4] An internal error occurred while processing task /app-engine-flex/flex_await_healthy/flex_await_healthy>2025年05月22日T05:55:45.336Z148159.jc.0: Timed out waiting for the app infrastructure to become healthy.
ERROR: (gcloud.app.deploy) Error Response: [4] An internal error occurred while processing task /app-engine-flex/flex_await_healthy/flex_await_healthy>2025年05月22日T05:55:45.336Z148159.jc.0: Timed out waiting for the app infrastructure to become healthy.
What might be happening. I was able to successfully deploy the application on the previous day without any issues.
I was able to successfully deploy the application on the just previous day without any issues. I was able to run the docker image that was built as part of the process successfully.
1 Answer 1
What happens is that the error indicates that updating an unhealthy deployment with a working Docker image doesn't always result in a healthy deployment.
According to this document, despite the error, if you provide a good Docker image, the deployment might eventually become healthy. Updating an existing version with a new Docker image, though allowed, is not a good practice. Additionally, there is currently no rollback in case of version failure.
Here are the things that you might consider as well:
- Extend app health check timeouts in app.yaml file. Add a /health endpoint and explicitly configure health checks and startup timeouts.
Update app.yaml file:
runtime: custom
env: flex
# Add health checks with higher timeout wwwwwwwwwwwwws
readiness_check:
path: "/health"
check_interval_sec: 10
timeout_sec: 4
failure_threshold: 10
success_threshold: 1
app_start_timeout_sec: 300
liveness_check:
path: "/health"
check_interval_sec: 10
timeout_sec: 4
failure_threshold: 5
- Retry the Deployment with a new
version IDThis ensures no internal state is cached, for instance:
gcloud app deploy --version=20250522
Check here if there were App Engine or GCE issues around May 21, 2025.
If the above suggestions do not help, then it might be observed that the issue is specifically for your project and requires a project inspection. It’s better to contact Google support for the same.
Sign up to request clarification or add additional context in comments.
1 Comment
KikoZam
Did this work? Any suggestions or confirmation to my solution would be appreciated.