PipelineDataflowConfigurationDetails¶

class oci.data_science.models.PipelineDataflowConfigurationDetails(**kwargs)¶

Bases: object

The configuration details of a Dataflow step.

Methods

__init__(**kwargs) Initializes a new PipelineDataflowConfigurationDetails object with values from keyword arguments.

Attributes

`configuration`	Gets the configuration of this PipelineDataflowConfigurationDetails.
`driver_shape`	Gets the driver_shape of this PipelineDataflowConfigurationDetails.
`driver_shape_config_details`	Gets the driver_shape_config_details of this PipelineDataflowConfigurationDetails.
`executor_shape`	Gets the executor_shape of this PipelineDataflowConfigurationDetails.
`executor_shape_config_details`	Gets the executor_shape_config_details of this PipelineDataflowConfigurationDetails.
`logs_bucket_uri`	Gets the logs_bucket_uri of this PipelineDataflowConfigurationDetails.
`num_executors`	Gets the num_executors of this PipelineDataflowConfigurationDetails.
`warehouse_bucket_uri`	Gets the warehouse_bucket_uri of this PipelineDataflowConfigurationDetails.

__init__(**kwargs)¶

Initializes a new PipelineDataflowConfigurationDetails object with values from keyword arguments. The following keyword arguments are supported (corresponding to the getters/setters of this class):

Parameters:

configuration (object) – The value to assign to the configuration property of this PipelineDataflowConfigurationDetails.
driver_shape (str) – The value to assign to the driver_shape property of this PipelineDataflowConfigurationDetails.
driver_shape_config_details (oci.data_science.models.PipelineShapeConfigDetails) – The value to assign to the driver_shape_config_details property of this PipelineDataflowConfigurationDetails.
executor_shape (str) – The value to assign to the executor_shape property of this PipelineDataflowConfigurationDetails.
executor_shape_config_details (oci.data_science.models.PipelineShapeConfigDetails) – The value to assign to the executor_shape_config_details property of this PipelineDataflowConfigurationDetails.
num_executors (int) – The value to assign to the num_executors property of this PipelineDataflowConfigurationDetails.
warehouse_bucket_uri (str) – The value to assign to the warehouse_bucket_uri property of this PipelineDataflowConfigurationDetails.
logs_bucket_uri (str) – The value to assign to the logs_bucket_uri property of this PipelineDataflowConfigurationDetails.

configuration¶

Gets the configuration of this PipelineDataflowConfigurationDetails. The Spark configuration passed to the running process.

Returns:	The configuration of this PipelineDataflowConfigurationDetails.
Return type:	object

driver_shape¶

Gets the driver_shape of this PipelineDataflowConfigurationDetails. The VM shape for the driver.

Returns:	The driver_shape of this PipelineDataflowConfigurationDetails.
Return type:	str

driver_shape_config_details¶

Gets the driver_shape_config_details of this PipelineDataflowConfigurationDetails.

Returns:	The driver_shape_config_details of this PipelineDataflowConfigurationDetails.
Return type:	oci.data_science.models.PipelineShapeConfigDetails

executor_shape¶

Gets the executor_shape of this PipelineDataflowConfigurationDetails. The VM shape for the executors.

Returns:	The executor_shape of this PipelineDataflowConfigurationDetails.
Return type:	str

executor_shape_config_details¶

Gets the executor_shape_config_details of this PipelineDataflowConfigurationDetails.

Returns:	The executor_shape_config_details of this PipelineDataflowConfigurationDetails.
Return type:	oci.data_science.models.PipelineShapeConfigDetails

logs_bucket_uri¶

Gets the logs_bucket_uri of this PipelineDataflowConfigurationDetails. An Oracle Cloud Infrastructure URI of the bucket where the Spark job logs are to be uploaded.

Returns:	The logs_bucket_uri of this PipelineDataflowConfigurationDetails.
Return type:	str

num_executors¶

Gets the num_executors of this PipelineDataflowConfigurationDetails. The number of executor VMs requested.

Returns:	The num_executors of this PipelineDataflowConfigurationDetails.
Return type:	int

warehouse_bucket_uri¶

Gets the warehouse_bucket_uri of this PipelineDataflowConfigurationDetails. An Oracle Cloud Infrastructure URI of the bucket to be used as default warehouse directory for BATCH SQL runs.

Returns:	The warehouse_bucket_uri of this PipelineDataflowConfigurationDetails.
Return type:	str