Set Up Object Store
Before running applications in Data Flow, two storage buckets that are required in Object Store
For more information, see the Object Storage documentation.
In Oracle Cloud Infrastructure, create two storage buckets in Object Store
for the following:
- Data Flow Logs
- Data Flow requires a bucket to store
the logs (both standard out and standard err) for every application run.
Create a standard storage tier bucket called
dataflow-logsin the Object Store service. The location of the bucket must follow the pattern:oci://dataflow-logs@<Object_Store_Namespace>/ - Data Flow Warehouse
- Data Flow requires a data warehouse
for Spark SQL applications. Create a standard storage tier bucket called
dataflow-warehousein the Object Store service. The location of the warehouse must follow the pattern:oci://dataflow-warehouse@<Object_Store_Namespace>/