Increasing the time limit for a Google Cloud Scheduler task#

In VIAL issue 724 a Cloud Scheduler job which triggered a Cloud Run hosted export script - by sending an HTTP POST to an endpoint - was returning an error. The logs showed the error happened exactly three minutes after the task started executing.

Turns out the HTTP endpoint (which does a lot of work) was taking longer than three minutes, which is the undocumented default time limit for Cloud Scheduler jobs.

Unfortunately it’s not possible to increase this time limit using the Cloud Scheduler web console, but it IS possible to increase the limit using the CLI gcloud tool.

To list the scheduler jobs:

1
~ % gcloud beta scheduler jobs list --project django-vaccinateca
2
ID                                        LOCATION  SCHEDULE (TZ)                                                    TARGET_TYPE  STATE
3
api-export-production                     us-west2  every 1 minutes (America/Los_Angeles)                            HTTP         ENABLED
4
api-export-staging                        us-west2  every 1 minutes (America/Los_Angeles)                            HTTP         ENABLED
5
mapbox-export                             us-west2  0 2,9,10,11,12,13,14,15,16,17,18,21 * * * (America/Los_Angeles)  HTTP         ENABLED
6
resolve-missing-counties-production       us-west2  */10 * * * * (America/Los_Angeles)                               HTTP         ENABLED
7
resolve-missing-counties-staging          us-west2  */10 * * * * (America/Los_Angeles)                               HTTP         ENABLED
8
vaccinatethestates-api-export-production  us-west2  */10 * * * * (America/Los_Angeles)                               HTTP         ENABLED
9
vaccinatethestates-api-export-staging     us-west2  */10 * * * * (America/Los_Angeles)                               HTTP         ENABLED

To increase the limit for one of them by name:

1
gcloud beta scheduler jobs update http \
2
  vaccinatethestates-api-export-production \
3
  --attempt-deadline=540s \
4
  --project django-vaccinateca

You can see the limit using describe:

1
~ % gcloud beta scheduler jobs describe vaccinatethestates-api-export-production --project django-vaccinateca
2
attemptDeadline: 180s
3
description: Hit /api/exportVaccinateTheStates to export to api.vaccinatethestates.com
4
  bucket
5
httpTarget:
6
  headers:
7
    Authorization: Bearer 27:...
8
    User-Agent: Google-Cloud-Scheduler
9
  httpMethod: POST
10
  uri: https://vial.calltheshots.us/api/exportVaccinateTheStates
11
lastAttemptTime: '2021-07-08T23:40:00.992830Z'
12
name: projects/django-vaccinateca/locations/us-west2/jobs/vaccinatethestates-api-export-production
13
retryConfig:
14
  maxBackoffDuration: 3600s
15
  maxDoublings: 5
16
  maxRetryDuration: 0s
17
  minBackoffDuration: 5s
18
schedule: '*/10 * * * *'
19
scheduleTime: '2021-07-08T23:50:00.061563Z'
20
state: ENABLED
21
status:
22
  code: 2
23
timeZone: America/Los_Angeles
24
userUpdateTime: '2021-06-10T23:34:48Z'