Oracle Cloud Infrastructure Documentation

Data Flow Dependency Packager Release Notes

Learn about the changes in each release of the third-party dependencies packager.

Release 2.4.0

  • Released: Apr 19, 2024
  • Upgrade Python version to 3.11.
  • Upgrade pip to latest for Python 3.11.
  • Support Multi Architecture Manifest build for both arm64 and amd64.
  • Backward compatible to previous Spark version archiver for the supported python versions.

Release 2.3.1

  • Released: Jun 08, 2023
  • Upgrade pip to latest for Python 3.6 and 3.8.
  • Install python-devel package for Python 3.8.
  • Support Multi Architecture Manifest build for both arm64 and amd64.

Release 2.2.0

  • Released: Mar 24, 2022
  • Release dependency-packager:2.2.0 at phx.ocir.io/oracle/dataflow/dependency-packager:2.2.0 and tag as latest.
  • Support option --validate <archive_file> to validate archive file locally.

Release 2.1.0

  • Released: Feb 19, 2022
  • Release dependency-packager:2.1.0 at phx.ocir.io/oracle/dataflow/dependency-packager:2.1.0 and tag as latest.
  • Add support of Python 3.8.11 for dependencies. Must specify Python version (3.6 or 3.8) using the -p option in the requirements.txt file.

Release 2.0.0

  • Released: Nov 07, 2021
  • Major change that uses the Ivy resolver from spark-core to download dependencies, instead of Maven.
  • Support packages.txt to be backward compatible with 1.0.x for Java applications.
  • Support --packages from the spark-submit CLI to download dependencies.
  • Support --exclude-packages from the spark-submit CLI to exclude certain dependencies.

Release 1.0.4

  • Released: Oct 20, 2021
  • Release dependency-packager:1.0.4 at phx.ocir.io/oracle/dataflow/dependency-packager:1.0.4 and tag as latest.
  • Remove leftover pom file for Java application.
  • Fix duplicate exclusion tag issue for dependency packager tool.
  • Handle last line without newline for the requirements.txt file.

Release 1.0.3

  • Released: Sep 21, 2021
  • Release dependency-packager:1.0.3 at phx.ocir.io/oracle/dataflow/dependency-packager:1.0.3 and tag as latest.
  • Handle packages that have no version information.

Release 1.0.2

  • Released: Apr 06, 2021
  • Release dependency-packager:1.0.2 at phx.ocir.io/oracle/dataflow/dependency-packager:1.0.2 and tag as latest.
  • Reduce image size and install libraries from yum repository.

Release 1.0.1

  • Released: Jan 06, 2021
  • Release dependency-packager:1.0.1 at phx.ocir.io/oracle/dataflow/dependency-packager:1.0.1 and tag as latest.
  • Remove pip, pip3 from generated the archive.zip file.