Command Line Tool

The earthengine tool is a utility program that lets you manage Earth Engine assets and tasks from the command line. It is installed automatically when you install the Python API. To check whether the tool is installed and functioning correctly, type the following on a command line:

    earthengine

If the tool is properly installed, it prints out a short summary of available commands. To get help on a specific command, use:

    earthengine command -h

When you first install the Python API you need to sign in using the authenticate command described below. The following sections describe the available commands in more detail.

Service account credentials

To use the CLI with a service account's credentials, use the service_account_file flag to point to a JSON file containing the service account's key.

    earthengine --service_account_file=service_account_creds.json

Usage in Colab

The Earth Engine Command Line Tool is preinstalled and ready for use in Google Colab.

Authentication

Authenticate for each new Colab session or if the virtual machine expires from inactivity (credentials are not saved across sessions).

Import the Python client library and call ee.Authenticate() to trigger the authentication flow. Follow the prompts to complete authentication. The default auth_mode in Colab is colab, see the Authentication guide for other options.

import ee
ee.Authenticate()

Command execution

To run command line utilities, like the Earth Engine CLI, you need to prepend command calls with an exclamation point.

!earthengine -h

Set a Cloud project

Use the --project option to set a Cloud project for each individual earthengine command.

!earthengine --project my-project <command>

Alternatively, set a default project to be used by all earthengine calls using the set_project command. The project will be added to a credentials file (~/.config/earthengine/credentials) and used for subsequent commands, unless overridden by the --project option. Set a default project for each new Colab session or if the virtual machine expires from inactivity (credentials are not saved across sessions).

!earthengine set_project my-project

Command Reference

authenticate

Authenticates the command line tool and Python client library to Earth Engine. Example:

    earthengine authenticate

Earth Engine uses the OAuth 2.0 protocol for authenticating clients. The earthengine authenticate command will prompt you through the authentication process using your web browser.

You will need to install gcloud if using the default gcloud authentication mode. See other authentication modes available through the auth_mode parameter in the authentication guide.

acl

Prints or updates the access control list (ACL) of an Earth Engine asset. The ACL controls who can read or write to an asset. Examples:

    earthengine acl get projects/my-project/assets/asset_id
    earthengine acl set public projects/my-project/assets/asset_id
    earthengine acl ch -u [email protected]:R projects/my-project/assets/asset_id

The get sub-command prints a JSON description of the ACL. The set sub-command sets an ACL provided in a file with the same JSON format. You can copy an ACL from one asset to others by saving the output from get and providing it to set.

The set sub-command also accepts two special ACL names:

  • private: Removes permissions from everyone except the owner.
  • public: Grants read permission to all users.

The ch sub-command lets you make individual changes to an ACL. To grant read permission specify -u [email protected]:R, to grant write permission specify -u [email protected]:W, and to remove a user's permissions specify -d [email protected]. The special user identifier AllUsers may be used to grant or revoke read permission to or from all users. (Note that revoking AllUsers permissions does not revoke any additional permissions you may have also granted to individual users.)

asset

Prints or updates metadata associated with the an Earth Engine asset. Examples:

    earthengine asset info projects/my-project/assets/asset_id
    earthengine asset set -p name=value projects/my-project/assets/asset_id

The info sub-command prints detailed information about the asset, including its metadata, in JSON form. The set sub-command sets individual metadata properties on an asset.

The values of metadata properties that you set may be either numbers or strings. When setting property names using the --property or -p flag, separate the property name and value with an equals sign. The data type is detected automatically, or you may specify it explicitly by prefixing the property name with (string), (number), or (date). For example, this sets a string-valued property with the value "42":

    earthengine asset set -p '(string)name=42' projects/my-project/assets/asset_id

(The quotes in this example prevent the shell from interpreting the parentheses. They may or may not be necessary, depending on your shell and platform.)

Date properties are just numbers that represent a number of milliseconds since the Unix epoch (i.e. midnight on January 1st, 1970) and may be specified directly as a number or in one of the following formats:

    YYYY-MM-DD
    YYYY-MM-DDThh:mm:ss
    YYYY-MM-DDThh:mm:ss.f

The time zone is assumed to be UTC. You may set the special start and end time properties using the --time_start and --time_end flags:

    earthengine asset set --time_start 1978-10-15T12:34:56 projects/my-project/assets/asset_id

cp

Copies an asset. Example:

    earthengine cp projects/my-project/assets/asset_id projects/my-project/assets/new_asset_id

create

Creates new folders and image collections. Example:

    earthengine create folder projects/my-project/assets/folder_id
    earthengine create collection projects/my-project/assets/collection_id

Use the folder sub-command to create folders and the collection to create image collections. You can specify the -p option to recursively create parent folders as required. Newly-created folders and images have private ACLs by default.

ls

Lists the contents of one or more folders or collections. Example:

    earthengine ls users/username

The -l option requests a long format with more information about each asset (currently just its type). You may specify --max_items number (or -m for short) to limit the number of items from each folder or collection you list:

    earthengine ls -m 10 projects/my-project/assets/my_large_collection

Running the ls command with no arguments will list the top-level folders that you own.

model

Tool with which to manipulate TensorFlow saved models.

model prepare

Prepare a saved model for serving in Earth Engine. Specifically, this transforms your SavedModel into a form suitable for processing requests from Earth Engine. (Learn more about SavedModel.)

    earthengine model prepare my_source_dir my_dest_dir '{"Conv2D:0":"my_input_band"}' '{"Sigmoid:0":"my_output_band"}'

Learn more about AI Platform models here. See a complete example here.

mv

Moves or renames an asset. Example:

    earthengine mv projects/my-project/assets/asset_id projects/my-project/assets/new_asset_id

project_config

Sets project configuration values. Before using this command, be sure to set a project using set_project.

get

To view a project configuration, use the get sub-command:

    earthengine alpha project_config get

If you have permission to view the project's batch task settings, the output contains:

  • maxConcurrentExports: a number indicating the maximum number of batch tasks that can run in parallel across all users for the given project. By default, this is set to the maximum allowed by the associated billing account's subscription plan.

Additionally, if you have permission to view the plan configuration, the output contains:

  • planMaxConcurrentExports, a number indicating the maximum number of batch tasks that can run in parallel across all users and projects that use the billing account.

set

To update the project's configuration, use the set sub-command. The following settings can be configured:

For example, to configure a project to only ever allow 10 tasks to run in parallel for the given project:

    earthengine alpha project_config set --max_concurrent_exports=10

The output displays the updated project configuration, identical to what get returns.

For more information about batch task parallelism, see the Earth Engine quotas page.

rm

Deletes one or more assets. Example:

    earthengine rm projects/my-project/assets/asset_id
    earthengine rm -r projects/my-project/assets/folder_id

You can use the -r flag to delete the contents of a folder or collection recursively. For safety when deleting multiple assets, you can use the --dry_run flag to verify exactly what will be deleted without actually deleting anything.

set_project

Sets the Google Cloud project through which computation requests are routed.

    earthengine set_project foo-project

This command is needed prior to running commands that require Cloud functionality, for example model.

task

Prints information about or manages long-running tasks. Examples:

    earthengine task list
    earthengine task list -l
    earthengine task info TASK_ID
    earthengine task cancel TASK_ID

The list sub-command lists basic information about the tasks that you submitted recently. The -l option requests a long format with more information about each task. The info sub-command prints detailed information about individual tasks. The cancel sub-command cancels one or more running tasks.

upload

Uploads images or tables from Google Cloud Storage to Earth Engine, or creates assets backed by external images.

image

To upload an image asset using default settings:

    earthengine upload image --asset_id=projects/my-project/assets/asset_id gs://bucket/image.tif

If you specify multiple input image files they will be interpreted as tiles of a single image asset. You can learn more about the options for uploading images to Earth Engine in Uploading image assets: Advanced options.

You can specify the pyramid reduction policy using the --pyramiding_policy flag, which can be set to one of mean (the default), sample, mode, min, or max. This will control how Earth Engine generates the pyramid of lower-resolution versions of your image:

    earthengine upload image --asset_id=projects/my-project/assets/asset_id --pyramiding_policy=sample gs://bucket/image.tif

You can use the --last_band_alpha to indicate that the mask for the image should be taken from an alpha channel in the last band:

    earthengine upload image --asset_id=projects/my-project/assets/asset_id --last_band_alpha gs://bucket/image.tif

You can specify a no-data value using the --nodata_value flag. This will mask any pixels in the image with that value:

    earthengine upload image --asset_id=users/myuser/asset --nodata_value=255 gs://bucket/image.tif

You may also specify metadata properties to set on the asset using the same flags that are accepted by the asset set command described above. The options are also described in the Image Manifest guide.

table

To upload a Shapefile, CSV, or TFRecord from Google Cloud Storage to an Earth Engine table asset, you can use any of:

    earthengine upload table --asset_id=projects/my-project/assets/myUploadedShapefile gs://bucket/foo.shp
    earthengine upload table --asset_id=projects/my-project/assets/myUploadedCSV gs://bucket/foo.csv
    earthengine upload table --asset_id=projects/my-project/assets/myUploadedTFRecord gs://bucket/foo.tfrecord

There are many options pertaining to the way in which CSV and TFRecord files are interpreted. You can see a complete list of table upload options by visiting the Table Manifest guide or with:

    earthengine upload table -h

external_image

To create an asset backed by an external image, run the upload_image command with a manifest:

earthengine alpha upload external_image --manifest /tmp/foo.json

An example manifest is:

{
  "name": "projects/{project}/assets/cogdemo1",
  "tilesets": [
    { "id": "0", "sources": [{ "uris": ["gs://ee-docs-demos/COG_demo.tif"] }] }
  ],
  "properties": {
    "source": "https://code.earthengine.google.com/d541cf8b268b2f9d8f834c255698201d"
  },
  "startTime": "2016-01-01T00:00:00.000000000Z",
  "endTime": "2016-12-31T15:01:23.000000000Z"
}

See the Cloud GeoTIFF guide and the Image Manifest guide for more details on constructing the manifest.