See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/292/display/redirect
Changes:
------------------------------------------ [...truncated 55.35 KB...]
TASK [python : build wheels of Python package Keras_Applications] ************** Tuesday 01 March 2022 01:01:26 +0000 (0:00:02.308) 5:51:25.967 ********* changed: [localhost]
TASK [python : get list of wheel files matching Keras_Applications] ************ Tuesday 01 March 2022 01:05:45 +0000 (0:04:18.648) 5:55:44.616 ********* ok: [localhost]
TASK [python : get filename of latest Keras_Applications wheel] **************** Tuesday 01 March 2022 01:05:45 +0000 (0:00:00.368) 5:55:44.984 ********* ok: [localhost]
TASK [python : install Keras_Applications-1.0.8-py3-none-any.whl Python package] *** Tuesday 01 March 2022 01:05:45 +0000 (0:00:00.067) 5:55:45.052 ********* changed: [localhost]
TASK [python : build wheels of Python package Keras_Preprocessing] ************* Tuesday 01 March 2022 01:05:47 +0000 (0:00:01.906) 5:55:46.958 ********* changed: [localhost]
TASK [python : get list of wheel files matching Keras_Preprocessing] *********** Tuesday 01 March 2022 01:05:51 +0000 (0:00:04.113) 5:55:51.072 ********* ok: [localhost]
TASK [python : get filename of latest Keras_Preprocessing wheel] *************** Tuesday 01 March 2022 01:05:52 +0000 (0:00:00.347) 5:55:51.419 ********* ok: [localhost]
TASK [python : install Keras_Preprocessing-1.1.2-py2.py3-none-any.whl Python package] *** Tuesday 01 March 2022 01:05:52 +0000 (0:00:00.066) 5:55:51.486 ********* changed: [localhost]
TASK [python : build wheels of Python package scipy] *************************** Tuesday 01 March 2022 01:05:54 +0000 (0:00:01.899) 5:55:53.386 ********* changed: [localhost]
TASK [python : get list of wheel files matching scipy] ************************* Tuesday 01 March 2022 01:06:01 +0000 (0:00:07.115) 5:56:00.502 ********* ok: [localhost]
TASK [python : get filename of latest scipy wheel] ***************************** Tuesday 01 March 2022 01:06:01 +0000 (0:00:00.349) 5:56:00.851 ********* ok: [localhost]
TASK [python : install scipy-1.7.3-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl Python package] *** Tuesday 01 March 2022 01:06:01 +0000 (0:00:00.066) 5:56:00.918 ********* changed: [localhost]
TASK [tensorflow : remove TensorFlow git sources from previous build] ********** Tuesday 01 March 2022 01:06:10 +0000 (0:00:08.933) 5:56:09.851 ********* changed: [localhost]
TASK [fetch tensorflow git source] ********************************************* Tuesday 01 March 2022 01:06:15 +0000 (0:00:04.789) 5:56:14.641 ********* skipping: [localhost]
TASK [unpack tensorflow git source] ******************************************** Tuesday 01 March 2022 01:06:15 +0000 (0:00:00.088) 5:56:14.729 ********* skipping: [localhost]
TASK [tensorflow : copy configure script] ************************************** Tuesday 01 March 2022 01:06:15 +0000 (0:00:00.053) 5:56:14.783 ********* skipping: [localhost]
TASK [fetch tensorflow from git] *********************************************** Tuesday 01 March 2022 01:06:15 +0000 (0:00:00.050) 5:56:14.833 ********* changed: [localhost]
TASK [tensorflow : copy configure script] ************************************** Tuesday 01 March 2022 01:06:36 +0000 (0:00:20.894) 5:56:35.727 ********* changed: [localhost]
TASK [tensorflow : Patch min bazel version] ************************************ Tuesday 01 March 2022 01:06:37 +0000 (0:00:00.580) 5:56:36.308 ********* changed: [localhost]
TASK [tensorflow : Create linklibs shell script] ******************************* Tuesday 01 March 2022 01:06:37 +0000 (0:00:00.336) 5:56:36.644 ********* changed: [localhost]
TASK [tensorflow : create readme file about unit tests] ************************ Tuesday 01 March 2022 01:06:38 +0000 (0:00:00.581) 5:56:37.226 ********* changed: [localhost]
TASK [tensorflow : add to the copied files] ************************************ Tuesday 01 March 2022 01:06:38 +0000 (0:00:00.584) 5:56:37.810 ********* changed: [localhost]
TASK [tensorflow : add to the long_description in setup.py] ******************** Tuesday 01 March 2022 01:06:39 +0000 (0:00:00.342) 5:56:38.153 ********* changed: [localhost]
TASK [tensorflow : build TensorFlow git for cp310-cp310] *********************** Tuesday 01 March 2022 01:06:39 +0000 (0:00:00.342) 5:56:38.496 ********* changed: [localhost]
TASK [tensorflow : Run unit tests on TensorFlow git for cp310-cp310] *********** Tuesday 01 March 2022 01:38:47 +0000 (0:32:08.292) 6:28:46.788 ********* fatal: [localhost]: FAILED! => changed=true cmd: |- set -xe source /tmp/workspace/venv-cp310-cp310/bin/activate source ./linklibs.sh source tensorflow/tools/ci_build/build_scripts/DEFAULT_TEST_TARGETS.sh bazel test --test_timeout=300,500,-1,-1 --flaky_test_attempts=3 --test_output=all --cache_test_results=no --config=nonccl \ --verbose_failures --build_tag_filters=-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu \ --test_tag_filters=-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu \ -- ${DEFAULT_BAZEL_TARGETS} \ -//tensorflow/lite/... -//tensorflow/python/tools/... -//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test -//tensorflow/compiler/mlir/lite/tests:prepare-tf.mlir.test -//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test -//tensorflow/python/eager:function_test -//tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test delta: '0:00:13.865917' end: '2022-03-01 01:39:01.857604' msg: non-zero return code rc: 1 start: '2022-03-01 01:38:47.991687' stderr: |- + source /tmp/workspace/venv-cp310-cp310/bin/activate ++ deactivate nondestructive ++ '[' -n '' ']' ++ '[' -n '' ']' ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r ++ '[' -n '' ']' ++ unset VIRTUAL_ENV ++ unset VIRTUAL_ENV_PROMPT ++ '[' '!' nondestructive = nondestructive ']' ++ VIRTUAL_ENV=/tmp/workspace/venv-cp310-cp310 ++ export VIRTUAL_ENV ++ _OLD_VIRTUAL_PATH=/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ++ PATH=/tmp/workspace/venv-cp310-cp310/bin:/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ++ export PATH ++ '[' -n '' ']' ++ '[' -z '' ']' ++ _OLD_VIRTUAL_PS1= ++ PS1='(venv-cp310-cp310) ' ++ export PS1 ++ VIRTUAL_ENV_PROMPT='(venv-cp310-cp310) ' ++ export VIRTUAL_ENV_PROMPT ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r + source ./linklibs.sh ++ echo Linklibs all OK + source tensorflow/tools/ci_build/build_scripts/DEFAULT_TEST_TARGETS.sh ++ set -x ++ DEFAULT_BAZEL_TARGETS='//tensorflow/... -//tensorflow/compiler/tf2tensorrt/... -//tensorflow/compiler/xrt/... -//tensorflow/core/tpu/... -//tensorflow/go/... -//tensorflow/java/... -//tensorflow/python/integration_testing/... -//tensorflow/tools/toolchains/...' + bazel test --test_timeout=300,500,-1,-1 --flaky_test_attempts=3 --test_output=all --cache_test_results=no --config=nonccl --verbose_failures --build_tag_filters=-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu --test_tag_filters=-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu -- //tensorflow/... -//tensorflow/compiler/tf2tensorrt/... -//tensorflow/compiler/xrt/... -//tensorflow/core/tpu/... -//tensorflow/go/... -//tensorflow/java/... -//tensorflow/python/integration_testing/... -//tensorflow/tools/toolchains/... -//tensorflow/lite/... -//tensorflow/python/tools/... -//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test -//tensorflow/compiler/mlir/lite/tests:prepare-tf.mlir.test -//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test -//tensorflow/python/eager:function_test -//tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test WARNING: Option 'java_toolchain' is deprecated WARNING: Option 'host_java_toolchain' is deprecated INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'test' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'test' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'build' options: --define framework_shared_object=true --java_toolchain=//tensorflow/tools/toolchains/java:tf_java_toolchain --host_java_toolchain=//tensorflow/tools/toolchains/java:tf_java_toolchain --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library INFO: Reading rc options for 'test' from /tmp/workspace/tensorflow-git/.tf_configure.bazelrc: Inherited 'build' options: --action_env PYTHON_BIN_PATH=/tmp/workspace/venv-cp310-cp310/bin/python3 --action_env PYTHON_LIB_PATH=/tmp/workspace/venv-cp310-cp310/lib/python3.10/site-packages --python_path=/tmp/workspace/venv-cp310-cp310/bin/python3 INFO: Reading rc options for 'test' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'build' options: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/common,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Reading rc options for 'test' from /tmp/workspace/tensorflow-git/.tf_configure.bazelrc: 'test' options: --flaky_test_attempts=3 --test_size_filters=small,medium INFO: Found applicable config definition build:short_logs in file /tmp/workspace/tensorflow-git/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tmp/workspace/tensorflow-git/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition test:v2 in file /tmp/workspace/tensorflow-git/.tf_configure.bazelrc: --test_tag_filters=-benchmark-test,-no_oss,-gpu,-oss_serial,-v1only --build_tag_filters=-benchmark-test,-no_oss,-gpu,-v1only INFO: Found applicable config definition build:nonccl in file /tmp/workspace/tensorflow-git/.bazelrc: --define=no_nccl_support=true INFO: Found applicable config definition build:linux in file /tmp/workspace/tensorflow-git/.bazelrc: --copt=-w --host_copt=-w --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++14 --host_cxxopt=-std=c++14 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tmp/workspace/tensorflow-git/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 349 packages loaded currently loading: tensorflow/lite/testing WARNING: /tmp/workspace/tensorflow-git/tensorflow/core/kernels/BUILD:1076:18: target '//tensorflow/core/kernels:bitcast_op' is deprecated: use //third_party/tensorflow/c/kernels:bitcast_op instead WARNING: /tmp/workspace/tensorflow-git/tensorflow/python/ops/distributions/BUILD:6:11: target '//tensorflow/python/ops/distributions:distributions' is deprecated: TensorFlow Distributions has migrated to TensorFlow Probability (https://github.com/tensorflow/probability). Deprecated copies remaining in tf.distributions will not receive new features, and will be removed by early 2019. You should update all usage of `tf.distributions` to `tfp.distributions`. Analyzing: 11528 targets (350 packages loaded) Analyzing: 11528 targets (350 packages loaded, 0 targets configured) DEBUG: Rule 'io_bazel_rules_docker' indicated that a canonical reproducible form can be obtained by modifying arguments shallow_since = "1596824487 -0400" DEBUG: Repository io_bazel_rules_docker instantiated at: /tmp/workspace/tensorflow-git/WORKSPACE:23:14: in <toplevel> /tmp/workspace/tensorflow-git/tensorflow/workspace0.bzl:110:34: in workspace /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/external/bazel_toolchains/repositories/repositories.bzl:35:23: in repositories Repository rule git_repository defined at: /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/external/bazel_tools/tools/build_defs/repo/git.bzl:199:33: in <toplevel> Analyzing: 11528 targets (391 packages loaded, 21839 targets configured) Analyzing: 11528 targets (418 packages loaded, 26659 targets configured) Analyzing: 11528 targets (420 packages loaded, 26949 targets configured) DEBUG: /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/external/tf_runtime/third_party/cuda/dependencies.bzl:19:10: NOTICE: The following command will download NVIDIA proprietary software. By using the software you agree to comply with the terms of the license agreement that accompanies the software. If you do not agree to the terms of the license agreement, do not use the software. Analyzing: 11528 targets (423 packages loaded, 28433 targets configured) Analyzing: 11528 targets (424 packages loaded, 28721 targets configured) Analyzing: 11528 targets (425 packages loaded, 30397 targets configured) ERROR: file 'external/bazel_tools/src/tools/launcher/_objs/launcher/dummy.o' is generated by these conflicting actions: Label: @bazel_tools//src/tools/launcher:launcher RuleClass: cc_binary rule Configuration: cc5cab1182d6d1b811e19e9869e235e9656990cc1fc87be8e58801af69b51a3f, 54a45dd4cb48ca4bd2dcf0202fe61f6619d267fdc260fdbc8cc4c44f1ff2707f Mnemonic: CppCompile Action key: 78c1550ea8713e55ac15128f44d3cc2713cc5536d88429ff60ceeab60a4ec7aa Progress message: Compiling src/tools/launcher/dummy.cc PrimaryInput: File:[/root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/external/bazel_tools[source]]src/tools/launcher/dummy.cc PrimaryOutput: File:[[<execution_root>]bazel-out/aarch64-opt/bin]external/bazel_tools/src/tools/launcher/_objs/launcher/dummy.o Owner information: ConfiguredTargetKey{label=@bazel_tools//src/tools/launcher:launcher, config=BuildConfigurationValue.Key[cc5cab1182d6d1b811e19e9869e235e9656990cc1fc87be8e58801af69b51a3f]}, ConfiguredTargetKey{label=@bazel_tools//src/tools/launcher:launcher, config=BuildConfigurationValue.Key[54a45dd4cb48ca4bd2dcf0202fe61f6619d267fdc260fdbc8cc4c44f1ff2707f]} MandatoryInputs: are equal Outputs: are equal ERROR: file 'external/bazel_tools/src/tools/launcher/_objs/launcher/dummy.pic.o' is generated by these conflicting actions: Label: @bazel_tools//src/tools/launcher:launcher RuleClass: cc_binary rule Configuration: cc5cab1182d6d1b811e19e9869e235e9656990cc1fc87be8e58801af69b51a3f, 54a45dd4cb48ca4bd2dcf0202fe61f6619d267fdc260fdbc8cc4c44f1ff2707f Mnemonic: CppCompile Action key: 4f07500d814ac612cb88fa1cbd92111f6edab95c71eaeb52af248355037d3b7a Progress message: Compiling src/tools/launcher/dummy.cc PrimaryInput: File:[/root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/external/bazel_tools[source]]src/tools/launcher/dummy.cc PrimaryOutput: File:[[<execution_root>]bazel-out/aarch64-opt/bin]external/bazel_tools/src/tools/launcher/_objs/launcher/dummy.pic.o Owner information: ConfiguredTargetKey{label=@bazel_tools//src/tools/launcher:launcher, config=BuildConfigurationValue.Key[cc5cab1182d6d1b811e19e9869e235e9656990cc1fc87be8e58801af69b51a3f]}, ConfiguredTargetKey{label=@bazel_tools//src/tools/launcher:launcher, config=BuildConfigurationValue.Key[54a45dd4cb48ca4bd2dcf0202fe61f6619d267fdc260fdbc8cc4c44f1ff2707f]} MandatoryInputs: are equal Outputs: are equal ERROR: com.google.devtools.build.lib.skyframe.ArtifactConflictFinder$ConflictException: com.google.devtools.build.lib.actions.MutableActionGraph$ActionConflictException: for external/bazel_tools/src/tools/launcher/_objs/launcher/dummy.pic.o, previous action: action 'Compiling src/tools/launcher/dummy.cc', attempted action: action 'Compiling src/tools/launcher/dummy.cc' INFO: Elapsed time: 13.511s INFO: 0 processes. FAILED: Build did NOT complete successfully (425 packages loaded, 33048 targets configured) ERROR: Couldn't start the build. Unable to run tests FAILED: Build did NOT complete successfully (425 packages loaded, 33048 targets configured) stderr_lines: <omitted> stdout: Linklibs all OK stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=181 changed=104 unreachable=0 failed=1 skipped=17 rescued=0 ignored=0
Tuesday 01 March 2022 01:39:01 +0000 (0:00:14.265) 6:29:01.053 ********* =============================================================================== tensorflow : Run unit tests on TensorFlow git for cp38-cp38 ---------- 4405.71s tensorflow : Run unit tests on TensorFlow git for cp37-cp37m --------- 4378.73s tensorflow : Run unit tests on TensorFlow git for cp39-cp39 ---------- 4278.08s tensorflow : build TensorFlow git for cp310-cp310 -------------------- 1928.29s tensorflow : build TensorFlow git for cp39-cp39 ---------------------- 1918.07s tensorflow : build TensorFlow git for cp38-cp38 ---------------------- 1889.54s tensorflow : build TensorFlow git for cp37-cp37m --------------------- 1677.01s python : build wheels of Python package h5py~=3.6.0 ------------------- 260.34s python : build wheels of Python package Keras_Applications ------------ 258.65s install bazel build requirements --------------------------------------- 41.29s tensorflow : populate cp39-cp39 virtualenv ----------------------------- 37.62s tensorflow : install Python package ------------------------------------ 36.63s tensorflow : populate cp310-cp310 virtualenv --------------------------- 34.83s tensorflow : populate cp38-cp38 virtualenv ----------------------------- 33.29s tensorflow : install Python package ------------------------------------ 33.25s tensorflow : install Python package ------------------------------------ 33.12s tensorflow : populate cp37-cp37m virtualenv ---------------------------- 32.69s fetch tensorflow from git ---------------------------------------------- 31.64s python : install numpy build requirements ------------------------------ 26.19s fetch tensorflow from git ---------------------------------------------- 22.60s Build step 'Execute shell' marked build as failure