See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/620/display/redirect
Changes:
------------------------------------------ [...truncated 55.46 KB...] TASK [python : get filename of latest numpy~=1.23.5 wheel] ********************* Friday 30 December 2022 21:56:31 +0000 (0:00:00.358) 3:45:55.963 ******* ok: [localhost]
TASK [python : install numpy-1.23.5-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl Python package] *** Friday 30 December 2022 21:56:32 +0000 (0:00:00.069) 3:45:56.032 ******* ok: [localhost]
TASK [python : build wheels of Python package h5py~=3.6.0] ********************* Friday 30 December 2022 21:56:34 +0000 (0:00:01.977) 3:45:58.010 ******* changed: [localhost]
TASK [python : get list of wheel files matching h5py~=3.6.0] ******************* Friday 30 December 2022 22:00:40 +0000 (0:04:06.616) 3:50:04.626 ******* ok: [localhost]
TASK [python : get filename of latest h5py~=3.6.0 wheel] *********************** Friday 30 December 2022 22:00:41 +0000 (0:00:00.377) 3:50:05.004 ******* ok: [localhost]
TASK [python : install h5py-3.6.0-cp310-cp310-linux_aarch64.whl Python package] *** Friday 30 December 2022 22:00:41 +0000 (0:00:00.073) 3:50:05.077 ******* changed: [localhost]
TASK [python : build wheels of Python package Keras_Preprocessing] ************* Friday 30 December 2022 22:00:43 +0000 (0:00:02.484) 3:50:07.562 ******* changed: [localhost]
TASK [python : get list of wheel files matching Keras_Preprocessing] *********** Friday 30 December 2022 22:00:48 +0000 (0:00:04.513) 3:50:12.076 ******* ok: [localhost]
TASK [python : get filename of latest Keras_Preprocessing wheel] *************** Friday 30 December 2022 22:00:48 +0000 (0:00:00.363) 3:50:12.439 ******* ok: [localhost]
TASK [python : install Keras_Preprocessing-1.1.2-py2.py3-none-any.whl Python package] *** Friday 30 December 2022 22:00:48 +0000 (0:00:00.073) 3:50:12.512 ******* changed: [localhost]
TASK [python : build wheels of Python package scipy] *************************** Friday 30 December 2022 22:00:50 +0000 (0:00:02.065) 3:50:14.578 ******* changed: [localhost]
TASK [python : get list of wheel files matching scipy] ************************* Friday 30 December 2022 22:00:59 +0000 (0:00:08.699) 3:50:23.278 ******* ok: [localhost]
TASK [python : get filename of latest scipy wheel] ***************************** Friday 30 December 2022 22:00:59 +0000 (0:00:00.364) 3:50:23.642 ******* ok: [localhost]
TASK [python : install scipy-1.9.3-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl Python package] *** Friday 30 December 2022 22:00:59 +0000 (0:00:00.073) 3:50:23.716 ******* changed: [localhost]
TASK [build and install wheels of binary Python packages for TensorFlow 1.15] *** Friday 30 December 2022 22:01:09 +0000 (0:00:09.271) 3:50:32.988 ******* skipping: [localhost] => (item=Keras_Applications)
TASK [tensorflow : Reset checkout to clean state] ****************************** Friday 30 December 2022 22:01:09 +0000 (0:00:00.061) 3:50:33.050 ******* changed: [localhost]
TASK [tensorflow : remove TensorFlow git sources from previous build] ********** Friday 30 December 2022 22:01:10 +0000 (0:00:00.935) 3:50:33.985 ******* skipping: [localhost]
TASK [fetch tensorflow git source] ********************************************* Friday 30 December 2022 22:01:10 +0000 (0:00:00.058) 3:50:34.044 ******* skipping: [localhost]
TASK [unpack tensorflow git source] ******************************************** Friday 30 December 2022 22:01:10 +0000 (0:00:00.058) 3:50:34.103 ******* skipping: [localhost]
TASK [tensorflow : Rename source dir for oneDNN build] ************************* Friday 30 December 2022 22:01:10 +0000 (0:00:00.052) 3:50:34.155 ******* skipping: [localhost]
TASK [fetch tensorflow from git] *********************************************** Friday 30 December 2022 22:01:10 +0000 (0:00:00.057) 3:50:34.213 ******* skipping: [localhost]
TASK [tensorflow : Get oneline version of git log for this checkout] *********** Friday 30 December 2022 22:01:10 +0000 (0:00:00.055) 3:50:34.268 ******* skipping: [localhost]
TASK [tensorflow : Show git log] *********************************************** Friday 30 December 2022 22:01:10 +0000 (0:00:00.053) 3:50:34.321 ******* skipping: [localhost]
TASK [tensorflow : Record git commit hash to variable] ************************* Friday 30 December 2022 22:01:10 +0000 (0:00:00.052) 3:50:34.374 ******* skipping: [localhost]
TASK [tensorflow : Save git commit hash to file] ******************************* Friday 30 December 2022 22:01:10 +0000 (0:00:00.052) 3:50:34.427 ******* skipping: [localhost]
TASK [tensorflow : Create linklibs shell script] ******************************* Friday 30 December 2022 22:01:10 +0000 (0:00:00.053) 3:50:34.481 ******* changed: [localhost]
TASK [tensorflow : create readme file about unit tests] ************************ Friday 30 December 2022 22:01:11 +0000 (0:00:00.592) 3:50:35.073 ******* changed: [localhost]
TASK [tensorflow : add to the copied files] ************************************ Friday 30 December 2022 22:01:11 +0000 (0:00:00.616) 3:50:35.690 ******* changed: [localhost]
TASK [tensorflow : add to the long_description in setup.py] ******************** Friday 30 December 2022 22:01:12 +0000 (0:00:00.366) 3:50:36.056 ******* changed: [localhost]
TASK [tensorflow : use nightly package requirements] *************************** Friday 30 December 2022 22:01:12 +0000 (0:00:00.349) 3:50:36.406 ******* changed: [localhost]
TASK [tensorflow : Get python site-packages location] ************************** Friday 30 December 2022 22:01:12 +0000 (0:00:00.351) 3:50:36.757 ******* changed: [localhost]
TASK [tensorflow : Configure default TensorFlow settings] ********************** Friday 30 December 2022 22:01:13 +0000 (0:00:00.726) 3:50:37.484 ******* changed: [localhost]
TASK [tensorflow : Set Python bin path] **************************************** Friday 30 December 2022 22:01:14 +0000 (0:00:00.611) 3:50:38.096 ******* changed: [localhost]
TASK [tensorflow : build TensorFlow git for cp310-cp310] *********************** Friday 30 December 2022 22:01:14 +0000 (0:00:00.614) 3:50:38.710 ******* fatal: [localhost]: FAILED! => changed=true cmd: |- set -xe; source /tmp/workspace/venv-cp310-cp310/bin/activate; source ./linklibs.sh; bazel clean --expunge; bazel build --config=nonccl --copt="-mtune=generic" --copt="-march=armv8-a" --copt="-O3" \ //tensorflow/tools/pip_package:build_pip_package --verbose_failures; mkdir tensorflow-pkg; bazel-bin/tensorflow/tools/pip_package/build_pip_package --cpu --project_name tensorflow_aarch64 ./tensorflow-pkg delta: '0:04:15.260822' end: '2022-12-30 22:05:30.282968' msg: non-zero return code rc: 37 start: '2022-12-30 22:01:15.022146' stderr: |- + source /tmp/workspace/venv-cp310-cp310/bin/activate ++ deactivate nondestructive ++ '[' -n '' ']' ++ '[' -n '' ']' ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r ++ '[' -n '' ']' ++ unset VIRTUAL_ENV ++ unset VIRTUAL_ENV_PROMPT ++ '[' '!' nondestructive = nondestructive ']' ++ VIRTUAL_ENV=/tmp/workspace/venv-cp310-cp310 ++ export VIRTUAL_ENV ++ _OLD_VIRTUAL_PATH=/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ++ PATH=/tmp/workspace/venv-cp310-cp310/bin:/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ++ export PATH ++ '[' -n '' ']' ++ '[' -z '' ']' ++ _OLD_VIRTUAL_PS1= ++ PS1='(venv-cp310-cp310) ' ++ export PS1 ++ VIRTUAL_ENV_PROMPT='(venv-cp310-cp310) ' ++ export VIRTUAL_ENV_PROMPT ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r + source ./linklibs.sh + bazel clean --expunge INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.tf_configure.bazelrc: Inherited 'build' options: --action_env PYTHON_BIN_PATH=/tmp/workspace/venv-cp310-cp310/bin/python3 --action_env PYTHON_LIB_PATH=/tmp/workspace/venv-cp310-cp310/lib/python3.10/site-packages --python_path=/tmp/workspace/venv-cp310-cp310/bin/python3 INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'build' options: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/common,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Found applicable config definition build:short_logs in file /tmp/workspace/tensorflow-git/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tmp/workspace/tensorflow-git/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:linux in file /tmp/workspace/tensorflow-git/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tmp/workspace/tensorflow-git/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS INFO: Starting clean (this may take a while). Consider using --async if the clean takes more than several minutes. + bazel build --config=nonccl --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3 //tensorflow/tools/pip_package:build_pip_package --verbose_failures Starting local Bazel server and connecting to it... INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.bazelrc: 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.tf_configure.bazelrc: 'build' options: --action_env PYTHON_BIN_PATH=/tmp/workspace/venv-cp310-cp310/bin/python3 --action_env PYTHON_LIB_PATH=/tmp/workspace/venv-cp310-cp310/lib/python3.10/site-packages --python_path=/tmp/workspace/venv-cp310-cp310/bin/python3 INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.bazelrc: 'build' options: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/common,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Found applicable config definition build:short_logs in file /tmp/workspace/tensorflow-git/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tmp/workspace/tensorflow-git/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:nonccl in file /tmp/workspace/tensorflow-git/.bazelrc: --define=no_nccl_support=true INFO: Found applicable config definition build:linux in file /tmp/workspace/tensorflow-git/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tmp/workspace/tensorflow-git/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded currently loading: tensorflow/tools/pip_package Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured) Analyzing: target //tensorflow/tools/pip_package:build_pip_package (284 packages loaded, 4173 targets configured)
Server terminated abruptly (error code: 14, error message: 'Socket closed', log file: '/root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/server/jvm.out') stderr_lines: <omitted> stdout: '' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=140 changed=82 unreachable=0 failed=1 skipped=38 rescued=0 ignored=0
Friday 30 December 2022 22:05:30 +0000 (0:04:15.634) 3:54:54.345 ******* =============================================================================== tensorflow : Run unit tests on TensorFlow git for cp39-cp39 ---------- 3775.11s tensorflow : Run unit tests on TensorFlow git for cp38-cp38 ---------- 3687.22s tensorflow : build TensorFlow git for cp39-cp39 ---------------------- 2493.34s tensorflow : build TensorFlow git for cp38-cp38 ---------------------- 2376.87s tensorflow : build TensorFlow git for cp310-cp310 --------------------- 255.63s python : build wheels of Python package h5py~=3.6.0 ------------------- 246.62s tensorflow : Run oss_serial unit tests on TensorFlow git for cp39-cp39 -- 94.16s tensorflow : Run oss_serial unit tests on TensorFlow git for cp38-cp38 -- 84.75s install bazel build requirements --------------------------------------- 47.49s tensorflow : populate cp39-cp39 virtualenv ----------------------------- 44.97s tensorflow : populate cp38-cp38 virtualenv ----------------------------- 43.85s tensorflow : populate cp310-cp310 virtualenv --------------------------- 38.83s tensorflow : install Python package ------------------------------------ 35.47s tensorflow : install Python package ------------------------------------ 33.24s python : install numpy build requirements ------------------------------ 28.44s fetch tensorflow from git ---------------------------------------------- 24.10s python : create cp310-cp310 virtualenv --------------------------------- 17.68s python : install h5py build requirements ------------------------------- 12.11s python : install scipy-1.9.3-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl Python package --- 9.27s python : build wheels of Python package scipy --------------------------- 8.70s Build step 'Execute shell' marked build as failure