See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/170/display/redirect

Changes:

------------------------------------------ [...truncated 35.55 KB...] TASK [python : install Keras_Preprocessing-1.1.2-py2.py3-none-any.whl Python package] *** Saturday 13 November 2021 20:14:44 +0000 (0:00:00.063) 2:04:06.483 ***** changed: [localhost]

TASK [python : build wheels of Python package scipy] *************************** Saturday 13 November 2021 20:14:46 +0000 (0:00:01.907) 2:04:08.390 ***** changed: [localhost]

TASK [python : get list of wheel files matching scipy] ************************* Saturday 13 November 2021 20:14:52 +0000 (0:00:06.232) 2:04:14.623 ***** ok: [localhost]

TASK [python : get filename of latest scipy wheel] ***************************** Saturday 13 November 2021 20:14:52 +0000 (0:00:00.330) 2:04:14.954 ***** ok: [localhost]

TASK [python : install scipy-1.5.4-cp37-cp37m-manylinux2014_aarch64.whl Python package] *** Saturday 13 November 2021 20:14:53 +0000 (0:00:00.072) 2:04:15.026 ***** changed: [localhost]

TASK [tensorflow : remove TensorFlow git sources from previous build] ********** Saturday 13 November 2021 20:14:59 +0000 (0:00:06.422) 2:04:21.449 ***** changed: [localhost]

TASK [fetch tensorflow git source] ********************************************* Saturday 13 November 2021 20:15:03 +0000 (0:00:04.423) 2:04:25.872 ***** skipping: [localhost]

TASK [unpack tensorflow git source] ******************************************** Saturday 13 November 2021 20:15:03 +0000 (0:00:00.074) 2:04:25.947 ***** skipping: [localhost]

TASK [tensorflow : copy configure script] ************************************** Saturday 13 November 2021 20:15:03 +0000 (0:00:00.052) 2:04:25.999 ***** skipping: [localhost]

TASK [tensorflow : drop Python 2.7 deps] *************************************** Saturday 13 November 2021 20:15:04 +0000 (0:00:00.048) 2:04:26.048 ***** skipping: [localhost] => (item=functools32) skipping: [localhost] => (item=enum34) skipping: [localhost] => (item=backports.weakref)

TASK [fetch tensorflow from git] *********************************************** Saturday 13 November 2021 20:15:04 +0000 (0:00:00.077) 2:04:26.125 ***** changed: [localhost]

TASK [tensorflow : copy configure script] ************************************** Saturday 13 November 2021 20:15:23 +0000 (0:00:19.778) 2:04:45.904 ***** changed: [localhost]

TASK [tensorflow : create readme file about unit tests] ************************ Saturday 13 November 2021 20:15:24 +0000 (0:00:00.515) 2:04:46.420 ***** changed: [localhost]

TASK [tensorflow : add to the copied files] ************************************ Saturday 13 November 2021 20:15:24 +0000 (0:00:00.556) 2:04:46.976 ***** changed: [localhost]

TASK [tensorflow : add to the long_description in setup.py] ******************** Saturday 13 November 2021 20:15:25 +0000 (0:00:00.310) 2:04:47.287 ***** changed: [localhost]

TASK [tensorflow : build TensorFlow git for cp37-cp37m] ************************ Saturday 13 November 2021 20:15:25 +0000 (0:00:00.315) 2:04:47.603 ***** fatal: [localhost]: FAILED! => changed=true cmd: |- set -xe source /tmp/workspace/venv-cp37-cp37m/bin/activate expect configure_tensorflow bazel clean --expunge export BAZEL_LINKLIBS=-l%:libstdc++.a bazel build --config=nonccl //tensorflow/tools/pip_package:build_pip_package --verbose_failures \ --copt=-ffp-contract=off --cxxopt=-ffp-contract=off mkdir tensorflow-pkg bazel-bin/tensorflow/tools/pip_package/build_pip_package --cpu --project_name tensorflow_aarch64 ./tensorflow-pkg delta: '0:24:52.000071' end: '2021-11-13 20:40:17.849712' msg: non-zero return code rc: 37 start: '2021-11-13 20:15:25.849641' stderr: |- + source /tmp/workspace/venv-cp37-cp37m/bin/activate ++ deactivate nondestructive ++ '[' -n '' ']' ++ '[' -n '' ']' ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r ++ '[' -n '' ']' ++ unset VIRTUAL_ENV ++ '[' '!' nondestructive = nondestructive ']' ++ VIRTUAL_ENV=/tmp/workspace/venv-cp37-cp37m ++ export VIRTUAL_ENV ++ _OLD_VIRTUAL_PATH=/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ++ PATH=/tmp/workspace/venv-cp37-cp37m/bin:/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ++ export PATH ++ '[' -n '' ']' ++ '[' -z '' ']' ++ _OLD_VIRTUAL_PS1= ++ '[' 'x(venv-cp37-cp37m) ' '!=' x ']' ++ PS1='(venv-cp37-cp37m) ' ++ export PS1 ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r + expect configure_tensorflow + bazel clean --expunge Starting local Bazel server and connecting to it... INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'build' options: --define framework_shared_object=true --java_toolchain=@tf_toolchains//toolchains/java:tf_java_toolchain --host_java_toolchain=@tf_toolchains//toolchains/java:tf_java_toolchain --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.tf_configure.bazelrc: Inherited 'build' options: --action_env PYTHON_BIN_PATH=/tmp/workspace/venv-cp37-cp37m/bin/python3 --action_env PYTHON_LIB_PATH=/tmp/workspace/venv-cp37-cp37m/lib/python3.7/site-packages --python_path=/tmp/workspace/venv-cp37-cp37m/bin/python3 INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'build' options: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/common,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/fallback,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Found applicable config definition build:short_logs in file /tmp/workspace/tensorflow-git/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tmp/workspace/tensorflow-git/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:linux in file /tmp/workspace/tensorflow-git/.bazelrc: --copt=-w --host_copt=-w --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++14 --host_cxxopt=-std=c++14 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tmp/workspace/tensorflow-git/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS INFO: Starting clean (this may take a while). Consider using --async if the clean takes more than several minutes. + export BAZEL_LINKLIBS=-l%:libstdc++.a + BAZEL_LINKLIBS=-l%:libstdc++.a + bazel build --config=nonccl //tensorflow/tools/pip_package:build_pip_package --verbose_failures --copt=-ffp-contract=off --cxxopt=-ffp-contract=off Starting local Bazel server and connecting to it... INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.bazelrc: 'build' options: --define framework_shared_object=true --java_toolchain=@tf_toolchains//toolchains/java:tf_java_toolchain --host_java_toolchain=@tf_toolchains//toolchains/java:tf_java_toolchain --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.tf_configure.bazelrc: 'build' options: --action_env PYTHON_BIN_PATH=/tmp/workspace/venv-cp37-cp37m/bin/python3 --action_env PYTHON_LIB_PATH=/tmp/workspace/venv-cp37-cp37m/lib/python3.7/site-packages --python_path=/tmp/workspace/venv-cp37-cp37m/bin/python3 INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.bazelrc: 'build' options: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/common,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/fallback,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Found applicable config definition build:short_logs in file /tmp/workspace/tensorflow-git/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tmp/workspace/tensorflow-git/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:nonccl in file /tmp/workspace/tensorflow-git/.bazelrc: --define=no_nccl_support=true INFO: Found applicable config definition build:linux in file /tmp/workspace/tensorflow-git/.bazelrc: --copt=-w --host_copt=-w --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++14 --host_cxxopt=-std=c++14 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tmp/workspace/tensorflow-git/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured) Analyzing: target //tensorflow/tools/pip_package:build_pip_package (234 packages loaded, 3915 targets configured) DEBUG: Rule 'io_bazel_rules_docker' indicated that a canonical reproducible form can be obtained by modifying arguments shallow_since = "1596824487 -0400" DEBUG: Repository io_bazel_rules_docker instantiated at: /tmp/workspace/tensorflow-git/WORKSPACE:23:14: in <toplevel> /tmp/workspace/tensorflow-git/tensorflow/workspace0.bzl:108:34: in workspace /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/external/bazel_toolchains/repositories/repositories.bzl:35:23: in repositories Repository rule git_repository defined at: /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/external/bazel_tools/tools/build_defs/repo/git.bzl:199:33: in <toplevel> Analyzing: target //tensorflow/tools/pip_package:build_pip_package (420 packages loaded, 18584 targets configured) INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (429 packages loaded, 25624 targets configured). INFO: Found 1 target... [0 / 225] [Prepa] BazelWorkspaceStatusAction stable-status.txt ... (17 actions, 0 running) [177 / 7,679] Compiling llvm-project/llvm/lib/TableGen/Record.cpp; 5s local ... (56 actions, 55 running) [386 / 7,931] Compiling llvm-project/llvm/lib/Support/ItaniumManglingCanonicalizer.cpp; 10s local ... (56 actions, 55 running) [753 / 8,476] Compiling llvm-project/llvm/lib/Support/ItaniumManglingCanonicalizer.cpp; 9s local ... (56 actions, 55 running) [1,778 / 8,874] Compiling llvm-project/llvm/utils/TableGen/RegisterInfoEmitter.cpp; 11s local ... (55 actions, 54 running) [2,180 / 8,874] Compiling llvm-project/llvm/utils/TableGen/GlobalISelEmitter.cpp; 20s local ... (56 actions, 55 running) [2,319 / 8,874] Compiling tensorflow/compiler/xla/service/cpu/runtime_single_threaded_matmul.cc; 14s local ... (56 actions, 55 running) [2,487 / 8,874] Compiling tensorflow/compiler/xla/service/cpu/runtime_single_threaded_matmul.cc; 28s local ... (56 actions, 55 running) [2,632 / 8,874] Compiling tensorflow/compiler/xla/service/cpu/runtime_single_threaded_matmul.cc; 45s local ... (56 actions, 55 running) [2,783 / 8,874] Compiling llvm-project/mlir/lib/Dialect/Linalg/IR/LinalgTypes.cpp; 60s local ... (56 actions, 55 running) [2,892 / 8,874] Compiling tensorflow/compiler/mlir/hlo/lib/Dialect/mhlo/transforms/legalize_to_linalg.cc; 73s local ... (56 actions, 55 running) [3,053 / 8,874] Compiling llvm-project/llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 26s local ... (56 actions, 55 running) [3,247 / 8,874] Compiling llvm-project/llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local ... (56 actions, 55 running) [3,407 / 8,874] Compiling llvm-project/llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 32s local ... (56 actions, 55 running) [3,577 / 8,874] Compiling llvm-project/llvm/lib/Passes/PassBuilder.cpp; 58s local ... (56 actions, 55 running) [4,165 / 8,875] Compiling llvm-project/llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local ... (56 actions, 55 running) [4,508 / 8,879] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 88s local ... (53 actions, 52 running) [5,383 / 8,920] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 147s local ... (56 actions, 55 running) [5,589 / 8,920] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 214s local ... (56 actions running) [5,926 / 8,920] Compiling tensorflow/core/kernels/padding_fifo_queue.cc; 57s local ... (56 actions running) [6,261 / 8,920] Compiling tensorflow/core/kernels/training_ops.cc; 135s local ... (56 actions running) [6,531 / 8,920] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops_a_m.cc; 149s local ... (56 actions running) [6,759 / 8,920] Compiling tensorflow/core/kernels/resource_variable_ops.cc; 123s local ... (56 actions running) [7,660 / 8,924] Compiling tensorflow/core/kernels/conv_grad_ops_3d.cc; 200s local ... (55 actions running) [8,152 / 9,083] Compiling tensorflow/core/kernels/matmul_op_real.cc; 333s local ... (56 actions running)

Server terminated abruptly (error code: 14, error message: 'Socket closed', log file: '/root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/server/jvm.out') stderr_lines: <omitted> stdout: |- spawn ./configure You have bazel 3.7.2 installed. Please specify the location of python. [Default is /tmp/workspace/venv-cp37-cp37m/bin/python3]:

Found possible Python library paths: /tmp/workspace/venv-cp37-cp37m/lib/python3.7/site-packages Please input the desired Python library path to use. Default is [/tmp/workspace/venv-cp37-cp37m/lib/python3.7/site-packages]

Do you wish to build TensorFlow with ROCm support? [y/N]: n No ROCm support will be enabled for TensorFlow.

Do you wish to build TensorFlow with CUDA support? [y/N]: n No CUDA support will be enabled for TensorFlow.

Do you wish to download a fresh release of clang? (Experimental) [y/N]: n Clang will not be downloaded.

Please specify optimization flags to use during compilation when bazel option "--config=opt" is specified [Default is -Wno-sign-compare]:

Would you like to interactively configure ./WORKSPACE for Android builds? [y/N]: n Not configuring the WORKSPACE for Android builds.

Preconfigured Bazel build configs. You can use any of the below by adding "--config=<>" to your build command. See .bazelrc for more details. --config=mkl # Build with MKL support. --config=mkl_aarch64 # Build with oneDNN and Compute Library for the Arm Architecture (ACL). --config=monolithic # Config for mostly static monolithic build. --config=numa # Build with NUMA support. --config=dynamic_kernels # (Experimental) Build kernels into separate shared objects. --config=v1 # Build with TensorFlow 1 API instead of TF 2 API. Preconfigured Bazel build configs to DISABLE default on features: --config=nogcp # Disable GCP support. --config=nonccl # Disable NVIDIA NCCL support. Configuration finished stdout_lines: <omitted>

PLAY RECAP ********************************************************************* localhost : ok=86 changed=49 unreachable=0 failed=1 skipped=13 rescued=0 ignored=0

Saturday 13 November 2021 20:40:17 +0000 (0:24:52.348) 2:29:39.951 ***** =============================================================================== tensorflow : Run unit tests on TensorFlow git for cp36-cp36m --------- 4090.99s tensorflow : build TensorFlow git for cp36-cp36m --------------------- 1635.69s tensorflow : build TensorFlow git for cp37-cp37m --------------------- 1492.35s python : build wheels of Python package h5py~=3.1.0 ------------------- 426.27s python : build wheels of Python package Keras_Applications ------------ 254.57s install bazel build requirements --------------------------------------- 46.82s tensorflow : populate cp36-cp36m virtualenv ---------------------------- 32.37s python : install numpy build requirements ------------------------------ 31.86s tensorflow : populate cp37-cp37m virtualenv ---------------------------- 30.43s tensorflow : install Python package ------------------------------------ 28.97s fetch tensorflow from git ---------------------------------------------- 19.78s fetch tensorflow from git ---------------------------------------------- 19.65s python : create cp37-cp37m virtualenv ---------------------------------- 17.09s python : install h5py build requirements ------------------------------- 16.87s bazel : fetch Bazel 3.7.2 binary from Github --------------------------- 15.29s install tensorflow build requirements ---------------------------------- 13.04s python : build wheels of Python package grpcio -------------------------- 8.09s python : install scipy-1.5.4-cp37-cp37m-manylinux2014_aarch64.whl Python package --- 6.42s python : build wheels of Python package scipy --------------------------- 6.23s python : build wheels of Python package Keras_Preprocessing ------------- 5.40s Build step 'Execute shell' marked build as failure