See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/569/display/redirect
Changes:
------------------------------------------ [...truncated 45.11 KB...] Sunday 13 November 2022 20:05:10 +0000 (0:04:15.739) 1:54:34.489 ******* ok: [localhost]
TASK [python : get filename of latest h5py~=3.6.0 wheel] *********************** Sunday 13 November 2022 20:05:11 +0000 (0:00:00.328) 1:54:34.817 ******* ok: [localhost]
TASK [python : install h5py-3.6.0-cp38-cp38-linux_aarch64.whl Python package] *** Sunday 13 November 2022 20:05:11 +0000 (0:00:00.064) 1:54:34.881 ******* changed: [localhost]
TASK [python : build wheels of Python package Keras_Applications] ************** Sunday 13 November 2022 20:05:13 +0000 (0:00:02.552) 1:54:37.434 ******* changed: [localhost]
TASK [python : get list of wheel files matching Keras_Applications] ************ Sunday 13 November 2022 20:09:26 +0000 (0:04:13.011) 1:58:50.446 ******* ok: [localhost]
TASK [python : get filename of latest Keras_Applications wheel] **************** Sunday 13 November 2022 20:09:27 +0000 (0:00:00.319) 1:58:50.765 ******* ok: [localhost]
TASK [python : install Keras_Applications-1.0.8-py3-none-any.whl Python package] *** Sunday 13 November 2022 20:09:27 +0000 (0:00:00.064) 1:58:50.830 ******* changed: [localhost]
TASK [python : build wheels of Python package Keras_Preprocessing] ************* Sunday 13 November 2022 20:09:29 +0000 (0:00:02.196) 1:58:53.026 ******* changed: [localhost]
TASK [python : get list of wheel files matching Keras_Preprocessing] *********** Sunday 13 November 2022 20:09:32 +0000 (0:00:03.198) 1:58:56.224 ******* ok: [localhost]
TASK [python : get filename of latest Keras_Preprocessing wheel] *************** Sunday 13 November 2022 20:09:32 +0000 (0:00:00.318) 1:58:56.543 ******* ok: [localhost]
TASK [python : install Keras_Preprocessing-1.1.2-py2.py3-none-any.whl Python package] *** Sunday 13 November 2022 20:09:32 +0000 (0:00:00.063) 1:58:56.607 ******* changed: [localhost]
TASK [python : build wheels of Python package scipy] *************************** Sunday 13 November 2022 20:09:35 +0000 (0:00:02.203) 1:58:58.811 ******* changed: [localhost]
TASK [python : get list of wheel files matching scipy] ************************* Sunday 13 November 2022 20:09:44 +0000 (0:00:09.442) 1:59:08.253 ******* ok: [localhost]
TASK [python : get filename of latest scipy wheel] ***************************** Sunday 13 November 2022 20:09:44 +0000 (0:00:00.314) 1:59:08.568 ******* ok: [localhost]
TASK [python : install scipy-1.7.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl Python package] *** Sunday 13 November 2022 20:09:44 +0000 (0:00:00.063) 1:59:08.632 ******* changed: [localhost]
TASK [tensorflow : Reset checkout to clean state] ****************************** Sunday 13 November 2022 20:09:59 +0000 (0:00:14.462) 1:59:23.094 ******* changed: [localhost]
TASK [tensorflow : remove TensorFlow git sources from previous build] ********** Sunday 13 November 2022 20:10:00 +0000 (0:00:00.888) 1:59:23.982 ******* skipping: [localhost]
TASK [fetch tensorflow git source] ********************************************* Sunday 13 November 2022 20:10:00 +0000 (0:00:00.051) 1:59:24.034 ******* skipping: [localhost]
TASK [unpack tensorflow git source] ******************************************** Sunday 13 November 2022 20:10:00 +0000 (0:00:00.052) 1:59:24.087 ******* skipping: [localhost]
TASK [tensorflow : Rename source dir for oneDNN build] ************************* Sunday 13 November 2022 20:10:00 +0000 (0:00:00.046) 1:59:24.133 ******* skipping: [localhost]
TASK [fetch tensorflow from git] *********************************************** Sunday 13 November 2022 20:10:00 +0000 (0:00:00.050) 1:59:24.183 ******* skipping: [localhost]
TASK [tensorflow : Get oneline version of git log for this checkout] *********** Sunday 13 November 2022 20:10:00 +0000 (0:00:00.047) 1:59:24.231 ******* skipping: [localhost]
TASK [tensorflow : Show git log] *********************************************** Sunday 13 November 2022 20:10:00 +0000 (0:00:00.045) 1:59:24.276 ******* skipping: [localhost]
TASK [tensorflow : Record git commit hash to variable] ************************* Sunday 13 November 2022 20:10:00 +0000 (0:00:00.045) 1:59:24.322 ******* skipping: [localhost]
TASK [tensorflow : Save git commit hash to file] ******************************* Sunday 13 November 2022 20:10:00 +0000 (0:00:00.046) 1:59:24.368 ******* skipping: [localhost]
TASK [tensorflow : Create linklibs shell script] ******************************* Sunday 13 November 2022 20:10:00 +0000 (0:00:00.046) 1:59:24.415 ******* changed: [localhost]
TASK [tensorflow : create readme file about unit tests] ************************ Sunday 13 November 2022 20:10:01 +0000 (0:00:00.521) 1:59:24.936 ******* changed: [localhost]
TASK [tensorflow : add to the copied files] ************************************ Sunday 13 November 2022 20:10:01 +0000 (0:00:00.532) 1:59:25.469 ******* changed: [localhost]
TASK [tensorflow : add to the long_description in setup.py] ******************** Sunday 13 November 2022 20:10:02 +0000 (0:00:00.304) 1:59:25.773 ******* changed: [localhost]
TASK [tensorflow : use nightly package requirements] *************************** Sunday 13 November 2022 20:10:02 +0000 (0:00:00.301) 1:59:26.075 ******* changed: [localhost]
TASK [tensorflow : Get python site-packages location] ************************** Sunday 13 November 2022 20:10:02 +0000 (0:00:00.306) 1:59:26.382 ******* changed: [localhost]
TASK [tensorflow : Configure default TensorFlow settings] ********************** Sunday 13 November 2022 20:10:03 +0000 (0:00:00.664) 1:59:27.047 ******* changed: [localhost]
TASK [tensorflow : Set Python bin path] **************************************** Sunday 13 November 2022 20:10:03 +0000 (0:00:00.541) 1:59:27.588 ******* changed: [localhost]
TASK [tensorflow : build TensorFlow git for cp38-cp38] ************************* Sunday 13 November 2022 20:10:04 +0000 (0:00:00.540) 1:59:28.129 ******* changed: [localhost]
TASK [tensorflow : Clean bazel install] **************************************** Sunday 13 November 2022 20:46:56 +0000 (0:36:52.010) 2:36:20.139 ******* changed: [localhost]
TASK [tensorflow : Run unit tests on TensorFlow git for cp38-cp38] ************* Sunday 13 November 2022 20:46:57 +0000 (0:00:00.624) 2:36:20.763 ******* fatal: [localhost]: FAILED! => changed=true cmd: |- set -xe; source /tmp/workspace/venv-cp38-cp38/bin/activate; source ./linklibs.sh; source tensorflow/tools/ci_build/build_scripts/DEFAULT_TEST_TARGETS.sh; bazel test --test_timeout=300,500,-1,-1 --flaky_test_attempts=3 --test_output=all --cache_test_results=no --config=nonccl \ --copt="-mtune=generic" --copt="-march=armv8-a" --copt="-O3" --verbose_failures \ --build_tag_filters=-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu \ --test_tag_filters=-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu --build_tests_only \ -- ${DEFAULT_BAZEL_TARGETS} \ -//tensorflow/lite/... -//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test -//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu -//tensorflow/python/client:session_list_devices_test -//tensorflow/python/data/kernel_tests:iterator_test_cpu -//tensorflow/python/training:server_lib_test \ delta: '0:00:26.224227' end: '2022-11-13 20:47:23.495453' msg: non-zero return code rc: 37 start: '2022-11-13 20:46:57.271226' stderr: |- + source /tmp/workspace/venv-cp38-cp38/bin/activate ++ deactivate nondestructive ++ '[' -n '' ']' ++ '[' -n '' ']' ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r ++ '[' -n '' ']' ++ unset VIRTUAL_ENV ++ '[' '!' nondestructive = nondestructive ']' ++ VIRTUAL_ENV=/tmp/workspace/venv-cp38-cp38 ++ export VIRTUAL_ENV ++ _OLD_VIRTUAL_PATH=/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ++ PATH=/tmp/workspace/venv-cp38-cp38/bin:/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ++ export PATH ++ '[' -n '' ']' ++ '[' -z '' ']' ++ _OLD_VIRTUAL_PS1= ++ '[' 'x(venv-cp38-cp38) ' '!=' x ']' ++ PS1='(venv-cp38-cp38) ' ++ export PS1 ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r + source ./linklibs.sh + source tensorflow/tools/ci_build/build_scripts/DEFAULT_TEST_TARGETS.sh ++ set -x ++ DEFAULT_BAZEL_TARGETS='//tensorflow/... -//tensorflow/compiler/tf2tensorrt/... -//tensorflow/compiler/xrt/... -//tensorflow/core/tpu/... -//tensorflow/go/... -//tensorflow/java/... -//tensorflow/python/integration_testing/... -//tensorflow/tools/toolchains/...' + bazel test --test_timeout=300,500,-1,-1 --flaky_test_attempts=3 --test_output=all --cache_test_results=no --config=nonccl --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3 --verbose_failures --build_tag_filters=-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu --test_tag_filters=-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu --build_tests_only -- //tensorflow/... -//tensorflow/compiler/tf2tensorrt/... -//tensorflow/compiler/xrt/... -//tensorflow/core/tpu/... -//tensorflow/go/... -//tensorflow/java/... -//tensorflow/python/integration_testing/... -//tensorflow/tools/toolchains/... -//tensorflow/lite/... -//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test -//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu -//tensorflow/python/client:session_list_devices_test -//tensorflow/python/data/kernel_tests:iterator_test_cpu -//tensorflow/python/training:server_lib_test Extracting Bazel installation... INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'test' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'test' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false INFO: Reading rc options for 'test' from /tmp/workspace/tensorflow-git/.tf_configure.bazelrc: Inherited 'build' options: --action_env PYTHON_BIN_PATH=/tmp/workspace/venv-cp38-cp38/bin/python3 --action_env PYTHON_LIB_PATH=/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages --python_path=/tmp/workspace/venv-cp38-cp38/bin/python3 INFO: Reading rc options for 'test' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'build' options: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/common,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Reading rc options for 'test' from /tmp/workspace/tensorflow-git/.tf_configure.bazelrc: 'test' options: --flaky_test_attempts=3 --test_size_filters=small,medium INFO: Found applicable config definition build:short_logs in file /tmp/workspace/tensorflow-git/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tmp/workspace/tensorflow-git/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition test:v2 in file /tmp/workspace/tensorflow-git/.tf_configure.bazelrc: --test_tag_filters=-benchmark-test,-no_oss,-gpu,-oss_serial,-v1only --build_tag_filters=-benchmark-test,-no_oss,-gpu,-v1only INFO: Found applicable config definition build:nonccl in file /tmp/workspace/tensorflow-git/.bazelrc: --define=no_nccl_support=true INFO: Found applicable config definition build:linux in file /tmp/workspace/tensorflow-git/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-unknown-warning --copt=-Wno-array-parameter --copt=-Wno-stringop-overflow --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tmp/workspace/tensorflow-git/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 328 packages loaded currently loading: tensorflow/core/kernels ... (11 packages) Loading: 406 packages loaded currently loading: tensorflow/lite/testing Analyzing: 3487 targets (407 packages loaded) Analyzing: 3487 targets (407 packages loaded, 0 targets configured) Analyzing: 3487 targets (440 packages loaded, 21565 targets configured) Analyzing: 3487 targets (444 packages loaded, 21723 targets configured) Analyzing: 3487 targets (444 packages loaded, 22841 targets configured)
Server terminated abruptly (error code: 14, error message: 'Socket closed', log file: '/root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/server/jvm.out') stderr_lines: <omitted> stdout: '' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=103 changed=62 unreachable=0 failed=1 skipped=26 rescued=0 ignored=0
Sunday 13 November 2022 20:47:23 +0000 (0:00:26.576) 2:36:47.340 ******* =============================================================================== tensorflow : Run unit tests on TensorFlow git for cp37-cp37m --------- 3648.30s tensorflow : build TensorFlow git for cp38-cp38 ---------------------- 2212.01s tensorflow : build TensorFlow git for cp37-cp37m --------------------- 2041.18s python : build wheels of Python package h5py~=3.6.0 ------------------- 255.74s python : build wheels of Python package Keras_Applications ------------ 253.01s install bazel build requirements --------------------------------------- 51.32s tensorflow : populate cp38-cp38 virtualenv ----------------------------- 44.46s tensorflow : populate cp37-cp37m virtualenv ---------------------------- 42.89s tensorflow : install Python package ------------------------------------ 33.32s python : install numpy build requirements ------------------------------ 32.62s tensorflow : Run unit tests on TensorFlow git for cp38-cp38 ------------ 26.58s fetch tensorflow from git ---------------------------------------------- 24.09s stop bazel server ------------------------------------------------------ 21.43s python : install h5py build requirements ------------------------------- 17.26s python : install scipy-1.7.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl Python package -- 14.46s python : create cp38-cp38 virtualenv ----------------------------------- 13.99s python : build wheels of Python package grpcio ------------------------- 13.36s python : build wheels of Python package scipy --------------------------- 9.44s install tensorflow build requirements ----------------------------------- 7.81s python : build wheels of Python package numpy>=1.20 --------------------- 7.68s Build step 'Execute shell' marked build as failure