Re-write the application to load accumulated data every 2 minutes.

Convert the streaming insert code to batch load for individual messages.

Load the original message to Google Cloud SQL, and export the table every hour to BigQuery via streaming inserts.

Estimate the average latency for data availability after streaming inserts, and always run
queries after waiting twice as long.

Cloud Pub/Sub, Cloud Dataflow, and Cloud Storage

Cloud Pub/Sub, Cloud Dataflow, and Local SSD

Cloud Pub/Sub, Cloud SQL, and Cloud Storage

Cloud Load Balancing, Cloud Dataflow, and Cloud Storage

If you have existing data in a separate file for each day, then create a partitioned table and upload each
file into the appropriate partition.

Run a query to get the records for a specific day from an existing table and for the destination table,
specify a partitioned table ending with the day in the format "$YYYYMMDD".

Create a partitioned table and stream new records to it every day.

Use ORDER BY to put a table's rows into chronological order and then change the table's type to
"Partitioned".

File upload

Google Drive

Google Cloud Storage

Google Cloud SQL

500 TB

1 GB

1 TB
500 GB

500 GB

Make a call to the Stackdriver API to list all logs, and apply an advanced filter.

In the Stackdriver logging admin interface, and enable a log sink export to BigQuery.

In the Stackdriver logging admin interface, enable a log sink export to Google Cloud
Pub/Sub, and subscribe to the topic from your monitoring tool.

Using the Stackdriver API, create a project sink with advanced log filter to export to
Pub/Sub, and subscribe to the topic from your monitoring tool.

It is optimized to handle a high volume of data instances in a job and to run more complex models.

Predictions are returned in the response message.

Predictions are written to output files in a Cloud Storage location that you specify.

It is optimized to minimize the latency of serving predictions

Using IAM roles, you cannot give a user access to only one table in a project, rather than all tables in a
project.

To give a user access to only one table in a project, grant the user the Bigtable Editor role for that table.

You can configure access control only at the project level.

To give a user access to only one table in a project, you must configure access through your application