Running a distributed Arroyo cluster
s3::
prefix
or the AWS_ENDPOINT_URL
environment variable.
The storage backend is configured by the following config properties:
checkpoint-url
(env var: ARROYO__CHECKPOINT_URL
) configures where checkpoints are written; for
high-availability this should be an object store, but may be a local directory
for testing and developingcompiler.artifact-url
(env var: ARROYO__COMPILER__ARTIFACT_URL
) controls where compiled UDF libs are storeds3://my-bucket/key/path
s3::https://my-custom-s3:1234/my-bucket/key/path
https://s3.us-east-1.amazonaws.com/my-bucket
file:///my/local/filesystem
/my/local/filesystem
gs://my-gcs-bucket