See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/99/display/redirect

Changes:

------------------------------------------ [...truncated 40.17 KB...] changed: [localhost]

TASK [python : get list of wheel files matching h5py~=3.6.0] ******************* Sunday 26 June 2022 03:50:48 +0000 (0:04:24.605) 1:54:13.663 *********** ok: [localhost]

TASK [python : get filename of latest h5py~=3.6.0 wheel] *********************** Sunday 26 June 2022 03:50:48 +0000 (0:00:00.311) 1:54:13.974 *********** ok: [localhost]

TASK [python : install h5py-3.6.0-cp38-cp38-linux_aarch64.whl Python package] *** Sunday 26 June 2022 03:50:49 +0000 (0:00:00.060) 1:54:14.035 *********** changed: [localhost]

TASK [python : build wheels of Python package Keras_Applications] ************** Sunday 26 June 2022 03:50:51 +0000 (0:00:02.533) 1:54:16.568 *********** changed: [localhost]

TASK [python : get list of wheel files matching Keras_Applications] ************ Sunday 26 June 2022 03:55:15 +0000 (0:04:24.071) 1:58:40.640 *********** ok: [localhost]

TASK [python : get filename of latest Keras_Applications wheel] **************** Sunday 26 June 2022 03:55:15 +0000 (0:00:00.312) 1:58:40.953 *********** ok: [localhost]

TASK [python : install Keras_Applications-1.0.8-py3-none-any.whl Python package] *** Sunday 26 June 2022 03:55:16 +0000 (0:00:00.062) 1:58:41.016 *********** changed: [localhost]

TASK [python : build wheels of Python package Keras_Preprocessing] ************* Sunday 26 June 2022 03:55:18 +0000 (0:00:02.180) 1:58:43.196 *********** changed: [localhost]

TASK [python : get list of wheel files matching Keras_Preprocessing] *********** Sunday 26 June 2022 03:55:23 +0000 (0:00:05.105) 1:58:48.302 *********** ok: [localhost]

TASK [python : get filename of latest Keras_Preprocessing wheel] *************** Sunday 26 June 2022 03:55:23 +0000 (0:00:00.312) 1:58:48.614 *********** ok: [localhost]

TASK [python : install Keras_Preprocessing-1.1.2-py2.py3-none-any.whl Python package] *** Sunday 26 June 2022 03:55:23 +0000 (0:00:00.062) 1:58:48.677 *********** changed: [localhost]

TASK [python : build wheels of Python package scipy] *************************** Sunday 26 June 2022 03:55:25 +0000 (0:00:02.188) 1:58:50.865 *********** changed: [localhost]

TASK [python : get list of wheel files matching scipy] ************************* Sunday 26 June 2022 03:55:34 +0000 (0:00:08.942) 1:58:59.807 *********** ok: [localhost]

TASK [python : get filename of latest scipy wheel] ***************************** Sunday 26 June 2022 03:55:35 +0000 (0:00:00.312) 1:59:00.120 *********** ok: [localhost]

TASK [python : install scipy-1.7.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl Python package] *** Sunday 26 June 2022 03:55:35 +0000 (0:00:00.061) 1:59:00.181 *********** changed: [localhost]

TASK [tensorflow : Set build dir for TensorFlow-oneDNN-ACL git] **************** Sunday 26 June 2022 03:55:49 +0000 (0:00:14.210) 1:59:14.392 *********** ok: [localhost]

TASK [tensorflow : remove TensorFlow-oneDNN-ACL git sources from previous build] *** Sunday 26 June 2022 03:55:49 +0000 (0:00:00.060) 1:59:14.452 *********** changed: [localhost]

TASK [fetch tensorflow-oneDNN-ACL git source] ********************************** Sunday 26 June 2022 03:55:54 +0000 (0:00:04.778) 1:59:19.231 *********** skipping: [localhost]

TASK [unpack tensorflow-oneDNN-ACL git source] ********************************* Sunday 26 June 2022 03:55:54 +0000 (0:00:00.071) 1:59:19.302 *********** skipping: [localhost]

TASK [tensorflow : Rename source dir for oneDNN build] ************************* Sunday 26 June 2022 03:55:54 +0000 (0:00:00.049) 1:59:19.352 *********** skipping: [localhost]

TASK [fetch tensorflow-oneDNN-ACL from git] ************************************ Sunday 26 June 2022 03:55:54 +0000 (0:00:00.051) 1:59:19.404 *********** changed: [localhost]

TASK [tensorflow : Get oneline version of git log for this checkout] *********** Sunday 26 June 2022 03:56:16 +0000 (0:00:22.308) 1:59:41.712 *********** changed: [localhost]

TASK [tensorflow : Show git log] *********************************************** Sunday 26 June 2022 03:56:17 +0000 (0:00:00.638) 1:59:42.350 *********** ok: [localhost] => git_log.stdout: 55b8d89dd5d25d1b1d7c317a8ae9ffacaffb3f9d Update TFRT dependency to use revision http://github.com/tensorflow/runtime/commit/1a28370b26c23d9d7c9399896ea5eba2....

TASK [tensorflow : use nightly package requirements] *************************** Sunday 26 June 2022 03:56:17 +0000 (0:00:00.056) 1:59:42.407 *********** changed: [localhost]

TASK [tensorflow : Use rolling bazel release instead of last_downstream_green] *** Sunday 26 June 2022 03:56:17 +0000 (0:00:00.305) 1:59:42.712 *********** ok: [localhost]

TASK [tensorflow : Create linklibs shell script] ******************************* Sunday 26 June 2022 03:56:18 +0000 (0:00:00.299) 1:59:43.012 *********** changed: [localhost]

TASK [tensorflow : create readme file about unit tests] ************************ Sunday 26 June 2022 03:56:18 +0000 (0:00:00.522) 1:59:43.535 *********** changed: [localhost]

TASK [tensorflow : add to the copied files] ************************************ Sunday 26 June 2022 03:56:19 +0000 (0:00:00.533) 1:59:44.068 *********** changed: [localhost]

TASK [tensorflow : add to the long_description in setup.py] ******************** Sunday 26 June 2022 03:56:19 +0000 (0:00:00.307) 1:59:44.376 *********** changed: [localhost]

TASK [tensorflow : Get python site-packages location] ************************** Sunday 26 June 2022 03:56:19 +0000 (0:00:00.302) 1:59:44.678 *********** changed: [localhost]

TASK [tensorflow : Configure default TensorFlow settings] ********************** Sunday 26 June 2022 03:56:20 +0000 (0:00:00.673) 1:59:45.352 *********** changed: [localhost]

TASK [tensorflow : Set Python bin path] **************************************** Sunday 26 June 2022 03:56:21 +0000 (0:00:00.648) 1:59:46.000 *********** changed: [localhost]

TASK [tensorflow : build TensorFlow-oneDNN-ACL git for cp38-cp38] ************** Sunday 26 June 2022 03:56:21 +0000 (0:00:00.655) 1:59:46.656 *********** fatal: [localhost]: FAILED! => changed=true cmd: |- set -xe; source /tmp/workspace/venv-cp38-cp38/bin/activate; source ./linklibs.sh; bazel clean --expunge; bazel build --config=nonccl --config=mkl_aarch64 --copt="-fopenmp" --linkopt="-lgomp" --copt="-mtune=generic" --copt="-march=armv8-a" --copt="-O3" \ //tensorflow/tools/pip_package:build_pip_package --verbose_failures; mkdir tensorflow-pkg; bazel-bin/tensorflow/tools/pip_package/build_pip_package --cpu --project_name tensorflow_aarch64 ./tensorflow-pkg delta: '0:04:16.526452' end: '2022-06-26 04:00:38.447181' msg: non-zero return code rc: 37 start: '2022-06-26 03:56:21.920729' stderr: |- + source /tmp/workspace/venv-cp38-cp38/bin/activate ++ deactivate nondestructive ++ '[' -n '' ']' ++ '[' -n '' ']' ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r ++ '[' -n '' ']' ++ unset VIRTUAL_ENV ++ '[' '!' nondestructive = nondestructive ']' ++ VIRTUAL_ENV=/tmp/workspace/venv-cp38-cp38 ++ export VIRTUAL_ENV ++ _OLD_VIRTUAL_PATH=/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ++ PATH=/tmp/workspace/venv-cp38-cp38/bin:/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ++ export PATH ++ '[' -n '' ']' ++ '[' -z '' ']' ++ _OLD_VIRTUAL_PS1= ++ '[' 'x(venv-cp38-cp38) ' '!=' x ']' ++ PS1='(venv-cp38-cp38) ' ++ export PS1 ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r + source ./linklibs.sh + bazel clean --expunge Starting local Bazel server and connecting to it... INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-oneDNN-ACL-git/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-oneDNN-ACL-git/.bazelrc: Inherited 'build' options: --define framework_shared_object=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-oneDNN-ACL-git/.tf_configure.bazelrc: Inherited 'build' options: --action_env PYTHON_BIN_PATH=/tmp/workspace/venv-cp38-cp38/bin/python3 --action_env PYTHON_LIB_PATH=/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages --python_path=/tmp/workspace/venv-cp38-cp38/bin/python3 INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-oneDNN-ACL-git/.bazelrc: Inherited 'build' options: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/common,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Found applicable config definition build:short_logs in file /tmp/workspace/tensorflow-oneDNN-ACL-git/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tmp/workspace/tensorflow-oneDNN-ACL-git/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:linux in file /tmp/workspace/tensorflow-oneDNN-ACL-git/.bazelrc: --copt=-w --host_copt=-w --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tmp/workspace/tensorflow-oneDNN-ACL-git/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS INFO: Starting clean (this may take a while). Consider using --async if the clean takes more than several minutes. + bazel build --config=nonccl --config=mkl_aarch64 --copt=-fopenmp --linkopt=-lgomp --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3 //tensorflow/tools/pip_package:build_pip_package --verbose_failures Starting local Bazel server and connecting to it... INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-oneDNN-ACL-git/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-oneDNN-ACL-git/.bazelrc: 'build' options: --define framework_shared_object=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-oneDNN-ACL-git/.tf_configure.bazelrc: 'build' options: --action_env PYTHON_BIN_PATH=/tmp/workspace/venv-cp38-cp38/bin/python3 --action_env PYTHON_LIB_PATH=/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages --python_path=/tmp/workspace/venv-cp38-cp38/bin/python3 INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-oneDNN-ACL-git/.bazelrc: 'build' options: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/common,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Found applicable config definition build:short_logs in file /tmp/workspace/tensorflow-oneDNN-ACL-git/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tmp/workspace/tensorflow-oneDNN-ACL-git/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:nonccl in file /tmp/workspace/tensorflow-oneDNN-ACL-git/.bazelrc: --define=no_nccl_support=true INFO: Found applicable config definition build:mkl_aarch64 in file /tmp/workspace/tensorflow-oneDNN-ACL-git/.bazelrc: --define=build_with_mkl_aarch64=true --define=build_with_openmp=true -c opt INFO: Found applicable config definition build:linux in file /tmp/workspace/tensorflow-oneDNN-ACL-git/.bazelrc: --copt=-w --host_copt=-w --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tmp/workspace/tensorflow-oneDNN-ACL-git/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured) Analyzing: target //tensorflow/tools/pip_package:build_pip_package (270 packages loaded, 3999 targets configured) Analyzing: target //tensorflow/tools/pip_package:build_pip_package (496 packages loaded, 30764 targets configured)

Server terminated abruptly (error code: 14, error message: 'Socket closed', log file: '/root/.cache/bazel/_bazel_root/7043a081cadd05f91bd91c35f2a2c120/server/jvm.out') stderr_lines: <omitted> stdout: '' stdout_lines: <omitted>

PLAY RECAP ********************************************************************* localhost : ok=103 changed=60 unreachable=0 failed=1 skipped=11 rescued=0 ignored=0

Sunday 26 June 2022 04:00:38 +0000 (0:04:16.860) 2:04:03.516 *********** =============================================================================== tensorflow : Run unit tests on TensorFlow-oneDNN-ACL git for cp37-cp37m 3447.38s tensorflow : build TensorFlow-oneDNN-ACL git for cp37-cp37m ---------- 2190.81s python : build wheels of Python package h5py~=3.6.0 ------------------- 264.61s python : build wheels of Python package Keras_Applications ------------ 264.07s tensorflow : build TensorFlow-oneDNN-ACL git for cp38-cp38 ------------ 256.86s tensorflow : populate cp37-cp37m virtualenv ---------------------------- 54.02s tensorflow : populate cp38-cp38 virtualenv ----------------------------- 50.17s install bazel build requirements --------------------------------------- 41.27s stop bazel server ------------------------------------------------------ 41.12s tensorflow : install Python package ------------------------------------ 31.55s python : install numpy build requirements ------------------------------ 27.12s fetch tensorflow-oneDNN-ACL from git ----------------------------------- 22.48s fetch tensorflow-oneDNN-ACL from git ----------------------------------- 22.31s python : install scipy-1.7.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl Python package -- 14.21s python : create cp38-cp38 virtualenv ----------------------------------- 13.80s python : install h5py build requirements ------------------------------- 13.73s python : build wheels of Python package scipy --------------------------- 8.94s install tensorflow build requirements ----------------------------------- 7.65s python : build wheels of Python package grpcio -------------------------- 5.87s python : build wheels of Python package Keras_Preprocessing ------------- 5.11s Build step 'Execute shell' marked build as failure