See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/395/display/redirect

Changes:

------------------------------------------ [...truncated 19.53 KB...] skipping: [localhost] => (item=3.9) skipping: [localhost] => (item=3.10) skipping: [localhost] => (item=3.11)

TASK [Build TensorFlow for each Python version (dual abi)] ********************* Tuesday 11 April 2023 02:56:38 +0100 (0:00:00.058) 0:00:33.718 *********

TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Tuesday 11 April 2023 02:56:38 +0100 (0:00:00.691) 0:00:34.410 ********* changed: [localhost]

TASK [tensorflow_in_container : Remove TensorFlow-oneDNN-ACL git sources from previous build] *** Tuesday 11 April 2023 02:56:39 +0100 (0:00:00.645) 0:00:35.055 ********* skipping: [localhost]

TASK [Fetch TensorFlow] ******************************************************** Tuesday 11 April 2023 02:56:39 +0100 (0:00:00.038) 0:00:35.093 ********* skipping: [localhost]

TASK [(Python 3.8) patch TensorFlow tree] ************************************** Tuesday 11 April 2023 02:56:39 +0100 (0:00:00.040) 0:00:35.134 *********

TASK [tensorflow : Create linklibs shell script] ******************************* Tuesday 11 April 2023 02:56:39 +0100 (0:00:00.156) 0:00:35.291 ********* changed: [localhost]

TASK [tensorflow : Create readme file about unit tests] ************************ Tuesday 11 April 2023 02:56:40 +0100 (0:00:00.696) 0:00:35.987 ********* changed: [localhost]

TASK [tensorflow : Add to the copied files] ************************************ Tuesday 11 April 2023 02:56:41 +0100 (0:00:00.701) 0:00:36.689 ********* changed: [localhost]

TASK [tensorflow : Add to the long_description in setup.py] ******************** Tuesday 11 April 2023 02:56:41 +0100 (0:00:00.563) 0:00:37.252 ********* changed: [localhost]

TASK [tensorflow : Use nightly package requirements] *************************** Tuesday 11 April 2023 02:56:42 +0100 (0:00:00.589) 0:00:37.842 ********* changed: [localhost]

TASK [tensorflow_in_container : (Python 3.8) copy upper constraints] *********** Tuesday 11 April 2023 02:56:42 +0100 (0:00:00.417) 0:00:38.259 ********* changed: [localhost]

TASK [tensorflow_in_container : (Python 3.8) build Python versioned container] *** Tuesday 11 April 2023 02:56:43 +0100 (0:00:00.724) 0:00:38.983 ********* ok: [localhost]

TASK [tensorflow_in_container : (Python 3.8) start build container] ************ Tuesday 11 April 2023 02:56:44 +0100 (0:00:01.443) 0:00:40.427 ********* changed: [localhost]

TASK [tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir] *** Tuesday 11 April 2023 02:56:47 +0100 (0:00:02.711) 0:00:43.139 ********* changed: [localhost]

TASK [tensorflow_in_container : (Python 3.8) create link for bazel cache] ****** Tuesday 11 April 2023 02:56:48 +0100 (0:00:01.166) 0:00:44.306 ********* changed: [localhost]

TASK [tensorflow_in_container : (Python 3.8) create link for bazelisk cache] *** Tuesday 11 April 2023 02:56:49 +0100 (0:00:00.837) 0:00:45.143 ********* changed: [localhost]

TASK [tensorflow_in_container : (Python 3.8) create link for pip cache] ******** Tuesday 11 April 2023 02:56:50 +0100 (0:00:00.839) 0:00:45.983 ********* changed: [localhost]

TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build] *** Tuesday 11 April 2023 02:56:51 +0100 (0:00:00.810) 0:00:46.793 ********* changed: [localhost]

TASK [tensorflow_in_container : Show list of installed Python packages for build] *** Tuesday 11 April 2023 02:56:53 +0100 (0:00:02.158) 0:00:48.952 ********* ok: [localhost] => pip_list_output.stdout: |- Package Version Location Installer ----------------------- -------------------- -------------------------------------- --------- absl-py 1.0.0 /usr/local/lib/python3.8/dist-packages pip astor 0.8.1 /usr/local/lib/python3.8/dist-packages pip astroid 2.11.7 /usr/local/lib/python3.8/dist-packages pip astunparse 1.6.3 /usr/local/lib/python3.8/dist-packages pip auditwheel 5.3.0 /usr/local/lib/python3.8/dist-packages pip bleach 6.0.0 /usr/local/lib/python3.8/dist-packages pip cachetools 5.3.0 /usr/local/lib/python3.8/dist-packages pip certifi 2019.11.28 /usr/lib/python3/dist-packages cffi 1.15.1 /usr/local/lib/python3.8/dist-packages pip chardet 3.0.4 /usr/lib/python3/dist-packages colorama 0.4.6 /usr/local/lib/python3.8/dist-packages pip cryptography 39.0.1 /usr/local/lib/python3.8/dist-packages pip Cython 0.29.33 /usr/local/lib/python3.8/dist-packages pip dbus-python 1.2.16 /usr/lib/python3/dist-packages dill 0.3.6 /usr/local/lib/python3.8/dist-packages pip docutils 0.19 /usr/local/lib/python3.8/dist-packages pip flatbuffers 2.0.7 /usr/local/lib/python3.8/dist-packages pip future 0.18.3 /usr/local/lib/python3.8/dist-packages pip gast 0.4.0 /usr/local/lib/python3.8/dist-packages pip google-auth 2.16.2 /usr/local/lib/python3.8/dist-packages pip google-auth-oauthlib 0.4.6 /usr/local/lib/python3.8/dist-packages pip google-pasta 0.2.0 /usr/local/lib/python3.8/dist-packages pip grpcio 1.49.1 /usr/local/lib/python3.8/dist-packages pip h5py 3.8.0 /usr/local/lib/python3.8/dist-packages pip idna 2.8 /usr/lib/python3/dist-packages importlib-metadata 6.0.0 /usr/local/lib/python3.8/dist-packages pip importlib-resources 5.12.0 /usr/local/lib/python3.8/dist-packages pip isort 5.12.0 /usr/local/lib/python3.8/dist-packages pip jaraco.classes 3.2.3 /usr/local/lib/python3.8/dist-packages pip jax 0.3.25 /usr/local/lib/python3.8/dist-packages pip jeepney 0.8.0 /usr/local/lib/python3.8/dist-packages pip junitparser 2.2.0 /usr/local/lib/python3.8/dist-packages pip Keras-Applications 1.0.8 /usr/local/lib/python3.8/dist-packages pip keras-nightly 2.13.0.dev2023031407 /usr/local/lib/python3.8/dist-packages pip Keras-Preprocessing 1.1.2 /usr/local/lib/python3.8/dist-packages pip keyring 23.13.1 /usr/local/lib/python3.8/dist-packages pip lazy-object-proxy 1.9.0 /usr/local/lib/python3.8/dist-packages pip lxml 4.9.2 /usr/local/lib/python3.8/dist-packages pip Markdown 3.4.1 /usr/local/lib/python3.8/dist-packages pip MarkupSafe 2.1.2 /usr/local/lib/python3.8/dist-packages pip mccabe 0.7.0 /usr/local/lib/python3.8/dist-packages pip more-itertools 9.0.0 /usr/local/lib/python3.8/dist-packages pip numpy 1.23.5 /usr/local/lib/python3.8/dist-packages pip oauthlib 3.2.2 /usr/local/lib/python3.8/dist-packages pip opt-einsum 3.3.0 /usr/local/lib/python3.8/dist-packages pip packaging 21.3 /usr/local/lib/python3.8/dist-packages pip pip 23.0.1 /usr/local/lib/python3.8/dist-packages pip pkginfo 1.9.6 /usr/local/lib/python3.8/dist-packages pip platformdirs 3.0.0 /usr/local/lib/python3.8/dist-packages pip portpicker 1.4.0 /usr/local/lib/python3.8/dist-packages pip protobuf 4.22.0 /usr/local/lib/python3.8/dist-packages pip pyasn1 0.4.8 /usr/local/lib/python3.8/dist-packages pip pyasn1-modules 0.2.8 /usr/local/lib/python3.8/dist-packages pip pycparser 2.21 /usr/local/lib/python3.8/dist-packages pip pyelftools 0.29 /usr/local/lib/python3.8/dist-packages pip Pygments 2.14.0 /usr/local/lib/python3.8/dist-packages pip PyGObject 3.36.0 /usr/lib/python3/dist-packages pylint 2.13.9 /usr/local/lib/python3.8/dist-packages pip pyparsing 3.0.9 /usr/local/lib/python3.8/dist-packages pip python-apt 2.0.1 /usr/lib/python3/dist-packages PyYAML 6.0 /usr/local/lib/python3.8/dist-packages pip readme-renderer 37.3 /usr/local/lib/python3.8/dist-packages pip requests 2.22.0 /usr/lib/python3/dist-packages requests-oauthlib 1.3.1 /usr/local/lib/python3.8/dist-packages pip requests-toolbelt 0.10.1 /usr/local/lib/python3.8/dist-packages pip requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages rfc3986 2.0.0 /usr/local/lib/python3.8/dist-packages pip rsa 4.9 /usr/local/lib/python3.8/dist-packages pip scipy 1.9.3 /usr/local/lib/python3.8/dist-packages pip SecretStorage 3.3.3 /usr/local/lib/python3.8/dist-packages pip setuptools 45.2.0 /usr/lib/python3/dist-packages six 1.15.0 /usr/local/lib/python3.8/dist-packages pip tb-nightly 2.13.0a20230314 /usr/local/lib/python3.8/dist-packages pip tensorboard-data-server 0.7.0 /usr/local/lib/python3.8/dist-packages pip tensorboard-plugin-wit 1.8.1 /usr/local/lib/python3.8/dist-packages pip termcolor 1.1.0 /usr/local/lib/python3.8/dist-packages pip tf-estimator-nightly 2.13.0.dev2023031408 /usr/local/lib/python3.8/dist-packages pip tomli 2.0.1 /usr/local/lib/python3.8/dist-packages pip tqdm 4.64.1 /usr/local/lib/python3.8/dist-packages pip twine 3.6.0 /usr/local/lib/python3.8/dist-packages pip typing-extensions 3.7.4.3 /usr/local/lib/python3.8/dist-packages pip urllib3 1.25.8 /usr/lib/python3/dist-packages webencodings 0.5.1 /usr/local/lib/python3.8/dist-packages pip Werkzeug 2.2.3 /usr/local/lib/python3.8/dist-packages pip wheel 0.38.4 /usr/local/lib/python3.8/dist-packages pip wrapt 1.12.1 /usr/local/lib/python3.8/dist-packages pip zipp 3.14.0 /usr/local/lib/python3.8/dist-packages pip

TASK [tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git] *** Tuesday 11 April 2023 02:56:53 +0100 (0:00:00.047) 0:00:49.000 ********* fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- Extracting Bazel installation... Starting local Bazel server and connecting to it... INFO: Invocation ID: f2084393-a8bf-43e5-8343-25eecbe51c4c INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Reading rc options for 'build' from /usertools/aarch64.bazelrc: 'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/local/bin/python3 --python_path=/usr/local/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --distinct_host_configuration=false --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3 INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64.bazelrc: --disk_cache=/tf/cache INFO: Found applicable config definition build:mkl_aarch64_threadpool in file /tf/tensorflow/.bazelrc: --define=build_with_mkl_aarch64=true -c opt INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --define=build_with_onednn_v2=true --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded INFO: Repository llvm-raw instantiated at: /tf/tensorflow/WORKSPACE:11:14: in <toplevel> /tf/tensorflow/tensorflow/workspace3.bzl:50:9: in workspace /tf/tensorflow/third_party/llvm/workspace.bzl:10:20: in repo /tf/tensorflow/third_party/repo.bzl:136:21: in tf_http_archive Repository rule _tf_http_archive defined at: /tf/tensorflow/third_party/repo.bzl:89:35: in <toplevel> Loading: 0 packages loaded INFO: Repository 'llvm-raw' used the following cache hits instead of downloading the corresponding file. * Hash 'b82597d2d5aeb231fffeef40433fd9a85b65d1c6cb84e42fe7fec8f6a507de6b' for https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-pr... If the definition of 'llvm-raw' was updated, verify that the hashes were also updated. ERROR: An error occurred during the fetch of repository 'llvm-raw': Traceback (most recent call last): File "/tf/tensorflow/third_party/repo.bzl", line 73, column 33, in _tf_http_archive_impl ctx.download_and_extract( Error in download_and_extract: java.io.IOException: Error extracting /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/external/llvm-raw/temp13001741996034221059/203cd159b6a9aca7a48c1847b0ff745beebf4b5e.tar.gz to /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/external/llvm-raw/temp13001741996034221059: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/external/llvm-raw/llvm/examples/Kaleidoscope/MCJIT/initial (No space left on device) ERROR: /tf/tensorflow/WORKSPACE:11:14: fetching _tf_http_archive rule //external:llvm-raw: Traceback (most recent call last): File "/tf/tensorflow/third_party/repo.bzl", line 73, column 33, in _tf_http_archive_impl ctx.download_and_extract( Error in download_and_extract: java.io.IOException: Error extracting /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/external/llvm-raw/temp13001741996034221059/203cd159b6a9aca7a48c1847b0ff745beebf4b5e.tar.gz to /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/external/llvm-raw/temp13001741996034221059: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/external/llvm-raw/llvm/examples/Kaleidoscope/MCJIT/initial (No space left on device) ERROR: no such package '@llvm-raw//utils/bazel': java.io.IOException: Error extracting /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/external/llvm-raw/temp13001741996034221059/203cd159b6a9aca7a48c1847b0ff745beebf4b5e.tar.gz to /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/external/llvm-raw/temp13001741996034221059: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/external/llvm-raw/llvm/examples/Kaleidoscope/MCJIT/initial (No space left on device) INFO: Elapsed time: 25.983s INFO: 0 processes. FAILED: Build did NOT complete successfully (0 packages loaded) FAILED: Build did NOT complete successfully (0 packages loaded) stderr_lines: <omitted> stdout: '' stdout_lines: <omitted>

PLAY RECAP ********************************************************************* localhost : ok=29 changed=20 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0

Tuesday 11 April 2023 02:57:20 +0100 (0:00:26.927) 0:01:15.927 ********* =============================================================================== tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git -- 26.93s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 21.57s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.74s tensorflow_in_container : (Python 3.8) start build container ------------ 2.71s Gathering Facts --------------------------------------------------------- 2.66s tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build --- 2.16s tensorflow_in_container : (Python 3.8) build Python versioned container --- 1.44s Create cache dirs ------------------------------------------------------- 1.39s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.17s tensorflow : Save git commit hash to file ------------------------------- 1.13s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.84s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.84s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.81s tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.72s tensorflow : Create readme file about unit tests ------------------------ 0.70s tensorflow : Create linklibs shell script ------------------------------- 0.70s Build TensorFlow for each Python version (dual abi) --------------------- 0.69s tensorflow_in_container : Reset checkout to clean state ----------------- 0.65s tensorflow : Add to the long_description in setup.py -------------------- 0.59s Build step 'Execute shell' marked build as failure