February 2023 - ldcg-ai-ml - op-lists.linaro.org

Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #706

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/706/disp…> Changes: ------------------------------------------ [...truncated 8.17 KB...] skipping: [localhost] => (item={'key': '2.8', 'value': {'tensorflow_version': '2.8.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.8.0', 'tensorboard_version': '==2.8.0', 'tensorflow_estimator_version': '==2.8.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/mlir/lite/tests:prepare-tf.mlir.test', '//tensorflow/compiler/mlir/tensorflow:dump_graph_test', '//tensorflow/core/common_runtime:direct_session_test', '//tensorflow/core/common_runtime:direct_session_with_debug_test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:quantize_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python:quantized_ops_test', '//tensorflow/python:script_ops_test', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.7', 'value': {'tensorflow_version': '2.7.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.5', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.7.0', 'tensorboard_version': '==2.7.0', 'tensorflow_estimator_version': '==2.7.0', 'python_install_packages': ['portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/java/...', '//tensorflow/lite/...', '//tensorflow/compiler/xla/python/...', '//tensorflow/compiler/xla/service/cpu/...', '//tensorflow/compiler/xla/tests/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/core/kernels:sparse_matmul_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/debug/cli:debugger_cli_common_test', '//tensorflow/python/debug/examples/v2:examples_v2_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/keras/mixed_precision:model_test', '//tensorflow/python/keras/preprocessing:image_test', '//tensorflow/python/kernel_tests:init_ops_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests:self_adjoint_eig_op_test', '//tensorflow/python/kernel_tests:sparse_matmul_op_test', '//tensorflow/python/lib/io:file_io_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python/ops/ragged:ragged_print_op_test', '//tensorflow/python/profiler/integration_test:profiler_api_test', '//tensorflow/python/profiler:profiler_v2_test', '//tensorflow/python/util:dispatch_test', '//tensorflow/python/util:traceback_utils_test', '//tensorflow/tools/api/tests:api_compatibility_test', '//tensorflow/tools/docs:tf_doctest', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.6', 'value': {'tensorflow_version': '2.6.5', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.6.0', 'tensorboard_version': '==2.6.0', 'tensorflow_estimator_version': '==2.6.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.5', 'value': {'tensorflow_version': '2.5.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.34.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.5.0', 'tensorboard_version': '==2.5.0', 'tensorflow_estimator_version': '==2.5.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.4', 'value': {'tensorflow_version': '2.4.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.3.3', 'grpcio_version': '~=1.32.0', 'h5py_version': '~=2.10', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.4.3', 'tensorboard_version': '==2.4.1', 'tensorflow_estimator_version': '==2.4.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '1.15', 'value': {'tensorflow_version': '1.15.5', 'bazel_version': '0.29.1', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.2.2', 'grpcio_version': '~=1.32.0', 'h5py_version': '==2.10', 'numpy_version': '~=1.18.0', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==1.2.2', 'tensorboard_version': '==1.15.0', 'tensorflow_estimator_version': '==1.15.2', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m']}}) TASK [tensorflow : Set TensorFlow and other package versions] ****************** Monday 27 February 2023 18:10:09 +0000 (0:00:00.257) 0:00:04.710 ******* ok: [localhost] TASK [tensorflow : Set build dir for TensorFlow git] *************************** Monday 27 February 2023 18:10:09 +0000 (0:00:00.083) 0:00:04.793 ******* ok: [localhost] TASK [tensorflow : Remove TensorFlow git sources from previous build] ********** Monday 27 February 2023 18:10:09 +0000 (0:00:00.047) 0:00:04.841 ******* changed: [localhost] TASK [tensorflow : Fetch TensorFlow] ******************************************* Monday 27 February 2023 18:10:13 +0000 (0:00:03.861) 0:00:08.702 ******* included: <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/confi…> for localhost TASK [tensorflow : Fetch TensorFlow git source] ******************************** Monday 27 February 2023 18:10:13 +0000 (0:00:00.116) 0:00:08.819 ******* skipping: [localhost] TASK [tensorflow : Unpack TensorFlow git source] ******************************* Monday 27 February 2023 18:10:13 +0000 (0:00:00.039) 0:00:08.859 ******* skipping: [localhost] TASK [tensorflow : Rename source dir for oneDNN build] ************************* Monday 27 February 2023 18:10:13 +0000 (0:00:00.038) 0:00:08.897 ******* skipping: [localhost] TASK [tensorflow : Fetch TensorFlow from git] ********************************** Monday 27 February 2023 18:10:13 +0000 (0:00:00.038) 0:00:08.936 ******* changed: [localhost] TASK [tensorflow : Fetch TensorFlow from git at commit] ************************ Monday 27 February 2023 18:10:36 +0000 (0:00:22.770) 0:00:31.706 ******* skipping: [localhost] TASK [tensorflow : Set world write access to source] *************************** Monday 27 February 2023 18:10:36 +0000 (0:00:00.036) 0:00:31.743 ******* changed: [localhost] TASK [tensorflow : Get oneline version of git log for this checkout] *********** Monday 27 February 2023 18:10:36 +0000 (0:00:00.375) 0:00:32.118 ******* changed: [localhost] TASK [tensorflow : Show git log] *********************************************** Monday 27 February 2023 18:10:37 +0000 (0:00:00.605) 0:00:32.724 ******* ok: [localhost] => git_log.stdout: 62a793ae3214ea6fdc41d780802b4c49d0270be1 Make inferReturnTypeComponentsFromOperands more resilient against cast failures. TASK [tensorflow : Record git commit hash to variable] ************************* Monday 27 February 2023 18:10:37 +0000 (0:00:00.044) 0:00:32.768 ******* ok: [localhost] TASK [tensorflow : Save git commit hash to file] ******************************* Monday 27 February 2023 18:10:37 +0000 (0:00:00.064) 0:00:32.833 ******* changed: [localhost] TASK [Build Bazel] ************************************************************* Monday 27 February 2023 18:10:38 +0000 (0:00:01.113) 0:00:33.947 ******* skipping: [localhost] TASK [Build TensorFlow for each Python version] ******************************** Monday 27 February 2023 18:10:38 +0000 (0:00:00.036) 0:00:33.983 ******* skipping: [localhost] => (item=3.8) skipping: [localhost] => (item=3.9) skipping: [localhost] => (item=3.10) skipping: [localhost] => (item=3.11) TASK [Build TensorFlow for each Python version (dual abi)] ********************* Monday 27 February 2023 18:10:38 +0000 (0:00:00.056) 0:00:34.040 ******* TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Monday 27 February 2023 18:10:39 +0000 (0:00:00.654) 0:00:34.694 ******* changed: [localhost] TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] *** Monday 27 February 2023 18:10:40 +0000 (0:00:00.627) 0:00:35.322 ******* skipping: [localhost] TASK [Fetch TensorFlow] ******************************************************** Monday 27 February 2023 18:10:40 +0000 (0:00:00.037) 0:00:35.359 ******* skipping: [localhost] TASK [(Python 3.8) patch TensorFlow tree] ************************************** Monday 27 February 2023 18:10:40 +0000 (0:00:00.038) 0:00:35.398 ******* TASK [tensorflow : Create linklibs shell script] ******************************* Monday 27 February 2023 18:10:40 +0000 (0:00:00.151) 0:00:35.550 ******* changed: [localhost] TASK [tensorflow : Create readme file about unit tests] ************************ Monday 27 February 2023 18:10:41 +0000 (0:00:00.693) 0:00:36.243 ******* changed: [localhost] TASK [tensorflow : Add to the copied files] ************************************ Monday 27 February 2023 18:10:41 +0000 (0:00:00.704) 0:00:36.947 ******* changed: [localhost] TASK [tensorflow : Add to the long_description in setup.py] ******************** Monday 27 February 2023 18:10:42 +0000 (0:00:00.561) 0:00:37.509 ******* changed: [localhost] TASK [tensorflow : Use nightly package requirements] *************************** Monday 27 February 2023 18:10:42 +0000 (0:00:00.552) 0:00:38.061 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) copy upper constraints] *********** Monday 27 February 2023 18:10:43 +0000 (0:00:00.392) 0:00:38.454 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) copy upper-constraints to within Docker context] *** Monday 27 February 2023 18:10:44 +0000 (0:00:00.769) 0:00:39.223 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) build Python versioned container] *** Monday 27 February 2023 18:10:44 +0000 (0:00:00.367) 0:00:39.591 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) start build container] ************ Monday 27 February 2023 18:11:27 +0000 (0:00:43.096) 0:01:22.687 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir] *** Monday 27 February 2023 18:11:29 +0000 (0:00:01.948) 0:01:24.636 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for bazel cache] ****** Monday 27 February 2023 18:11:30 +0000 (0:00:01.194) 0:01:25.830 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for bazelisk cache] *** Monday 27 February 2023 18:11:31 +0000 (0:00:00.828) 0:01:26.659 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for pip cache] ******** Monday 27 February 2023 18:11:32 +0000 (0:00:00.832) 0:01:27.492 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) build TensorFlow git] ************* Monday 27 February 2023 18:11:33 +0000 (0:00:00.884) 0:01:28.376 ******* fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- Extracting Bazel installation... Starting local Bazel server and connecting to it... INFO: Invocation ID: 67033efc-3ee3-4d84-ad37-0241d975ccb5 INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Reading rc options for 'build' from /usertools/aarch64.bazelrc: 'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/local/bin/python3 --python_path=/usr/local/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --distinct_host_configuration=false --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3 INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64.bazelrc: --disk_cache=/tf/cache INFO: Found applicable config definition build:ambe in file /usertools/aarch64.bazelrc: --distinct_host_configuration=false --flaky_test_attempts=3 --action_env=PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin --host_crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --extra_toolchains=@ml2014_aarch64_config_aarch64//crosstool:toolchain-linux-aarch64 --extra_execution_platforms=@ml2014_aarch64_config_aarch64_platform//:platform --host_platform=@ml2014_aarch64_config_aarch64_platform//:platform --platforms=@ml2014_aarch64_config_aarch64_platform//:platform --repo_env=TF_PYTHON_CONFIG_REPO=@ml2014_aarch64_config_python INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded currently loading: tensorflow/tools/pip_package Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured) Analyzing: target //tensorflow/tools/pip_package:build_pip_package (286 packages loaded, 4248 targets configured) Analyzing: target //tensorflow/tools/pip_package:build_pip_package (590 packages loaded, 32772 targets configured) INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (590 packages loaded, 33790 targets configured). INFO: Found 1 target... [0 / 101] [Prepa] Creating source manifest for //tensorflow/lite/tools:visualize ... (17 actions, 0 running) [7,348 / 17,715] Compiling tensorflow/tsl/platform/protobuf_util.cc; 6s local, remote-cache ... (111 actions, 110 running) [9,698 / 21,273] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 14s local, remote-cache ... (110 actions, 109 running) [11,721 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 23s local, remote-cache ... (111 actions, 110 running) [11,796 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 35s local, remote-cache ... (111 actions, 110 running) [12,263 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 48s local, remote-cache ... (111 actions, 110 running) [12,509 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 63s local, remote-cache ... (109 actions, 108 running) [12,757 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 80s local, remote-cache ... (111 actions, 110 running) [13,045 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 100s local, remote-cache ... (111 actions, 110 running) [13,200 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 123s local, remote-cache ... (109 actions, 108 running) [13,369 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 150s local, remote-cache ... (111 actions, 110 running) [13,613 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 180s local, remote-cache ... (111 actions, 110 running) [13,807 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 215s local, remote-cache ... (111 actions, 110 running) [14,086 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 255s local, remote-cache ... (111 actions, 110 running) [14,441 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 302s local, remote-cache ... (111 actions, 110 running) [14,792 / 21,430] Compiling tensorflow/core/util/batch_util.cc; 68s local, remote-cache ... (111 actions, 110 running) [15,172 / 21,430] Compiling tensorflow/core/kernels/rnn/lstm_ops.cc; 50s local, remote-cache ... (111 actions, 110 running) [15,584 / 21,430] Compiling tensorflow/core/kernels/padding_fifo_queue.cc; 82s local, remote-cache ... (111 actions, 110 running) [17,984 / 21,430] Compiling tensorflow/core/kernels/training_ops.cc; 112s local, remote-cache ... (111 actions, 110 running) [18,792 / 21,430] Compiling tensorflow/core/kernels/training_ops.cc; 205s local, remote-cache ... (111 actions, 110 running) [19,002 / 21,430] Compiling tensorflow/compiler/xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 167s local, remote-cache ... (111 actions, 110 running) [19,189 / 21,430] Compiling tensorflow/core/kernels/argmax_op.cc; 250s local, remote-cache ... (112 actions running) [19,633 / 21,430] Compiling tensorflow/core/kernels/matmul_op_real.cc; 387s local, remote-cache ... (112 actions running) ERROR: /tf/tensorflow/tensorflow/compiler/mlir/quantization/tensorflow/BUILD:272:11: Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/tf_quant_ops.cc failed: (Exit 1): gcc failed: error executing command /dt10/usr/bin/gcc -MD -MF bazel-out/aarch64-opt/bin/tensorflow/compiler/mlir/quantization/tensorflow/_objs/tf_quant_ops/tf_quant_ops.pic.d ... (remaining 213 arguments skipped) In file included from ./tensorflow/compiler/mlir/quantization/tensorflow/passes/tf_quant_ops.h:36, from tensorflow/compiler/mlir/quantization/tensorflow/passes/tf_quant_ops.cc:15: ./tensorflow/compiler/mlir/tensorflow/ir/tf_traits.h: In static member function 'static mlir::LogicalResult mlir::OpTrait::TF::SameOperandsAndResultTypeResolveRef<ConcreteType>::inferReturnTypeComponentsFromOperands(mlir::MLIRContext*, std::optional<mlir::Location>, mlir::ValueShapeRange, mlir::DictionaryAttr, mlir::RegionRange, llvm::SmallVectorImpl<mlir::ShapedTypeComponents>&)': ./tensorflow/compiler/mlir/tensorflow/ir/tf_traits.h:167:55: error: expected primary-expression before '>' token 167 | auto shape_type = ty.dyn_cast_or_null<ShapedType>(); | ^ ./tensorflow/compiler/mlir/tensorflow/ir/tf_traits.h:167:57: error: expected primary-expression before ')' token 167 | auto shape_type = ty.dyn_cast_or_null<ShapedType>(); | ^ Target //tensorflow/tools/pip_package:build_pip_package failed to build Use --verbose_failures to see the command lines of failed build steps. INFO: Elapsed time: 1101.906s, Critical Path: 394.52s INFO: 19709 processes: 11497 disk cache hit, 5109 internal, 3103 local. FAILED: Build did NOT complete successfully FAILED: Build did NOT complete successfully stderr_lines: <omitted> stdout: '' stdout_lines: <omitted> PLAY RECAP ********************************************************************* localhost : ok=28 changed=21 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0 Monday 27 February 2023 18:29:56 +0000 (0:18:22.935) 0:19:51.312 ******* =============================================================================== tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 1102.94s tensorflow_in_container : (Python 3.8) build Python versioned container -- 43.10s tensorflow : Fetch TensorFlow from git --------------------------------- 22.77s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.86s tensorflow_in_container : (Python 3.8) start build container ------------ 1.95s Gathering Facts --------------------------------------------------------- 1.67s Create cache dirs ------------------------------------------------------- 1.38s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.19s tensorflow : Save git commit hash to file ------------------------------- 1.11s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.88s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.83s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.83s tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.77s tensorflow : Create readme file about unit tests ------------------------ 0.70s tensorflow : Create linklibs shell script ------------------------------- 0.69s Build TensorFlow for each Python version (dual abi) --------------------- 0.65s tensorflow_in_container : Reset checkout to clean state ----------------- 0.63s tensorflow : Get oneline version of git log for this checkout ----------- 0.61s tensorflow : Add to the copied files ------------------------------------ 0.56s Build step 'Execute shell' marked build as failure

1 year, 9 months

1
1
0 0

Build failed in Jenkins: Tensorflow oneDNN Python package (manylinux2014 nightly) #349

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/3…> Changes: ------------------------------------------ [...truncated 16.71 KB...] TASK [tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build] *** Friday 24 February 2023 01:56:10 +0000 (0:00:00.044) 0:00:05.786 ******* changed: [localhost] TASK [tensorflow : Fetch TensorFlow] ******************************************* Friday 24 February 2023 01:56:13 +0000 (0:00:03.453) 0:00:09.239 ******* included: <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/w…> for localhost TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL git source] ********************* Friday 24 February 2023 01:56:13 +0000 (0:00:00.115) 0:00:09.354 ******* skipping: [localhost] TASK [tensorflow : Unpack TensorFlow-oneDNN-ACL git source] ******************** Friday 24 February 2023 01:56:13 +0000 (0:00:00.040) 0:00:09.395 ******* skipping: [localhost] TASK [tensorflow : Rename source dir for oneDNN build] ************************* Friday 24 February 2023 01:56:13 +0000 (0:00:00.037) 0:00:09.432 ******* skipping: [localhost] TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL from git] *********************** Friday 24 February 2023 01:56:13 +0000 (0:00:00.038) 0:00:09.471 ******* changed: [localhost] TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL from git at commit] ************* Friday 24 February 2023 01:56:35 +0000 (0:00:21.968) 0:00:31.440 ******* skipping: [localhost] TASK [tensorflow : Set world write access to source] *************************** Friday 24 February 2023 01:56:35 +0000 (0:00:00.036) 0:00:31.477 ******* changed: [localhost] TASK [tensorflow : Get oneline version of git log for this checkout] *********** Friday 24 February 2023 01:56:36 +0000 (0:00:00.374) 0:00:31.852 ******* changed: [localhost] TASK [tensorflow : Show git log] *********************************************** Friday 24 February 2023 01:56:36 +0000 (0:00:00.585) 0:00:32.438 ******* ok: [localhost] => git_log.stdout: 3f43b4eb7c183b3ce077dbee5b06c1b1ac201d72 Support quantizing models that use asset files to initialize resources. TASK [tensorflow : Record git commit hash to variable] ************************* Friday 24 February 2023 01:56:36 +0000 (0:00:00.044) 0:00:32.482 ******* ok: [localhost] TASK [tensorflow : Save git commit hash to file] ******************************* Friday 24 February 2023 01:56:36 +0000 (0:00:00.062) 0:00:32.544 ******* changed: [localhost] TASK [Build Bazel] ************************************************************* Friday 24 February 2023 01:56:38 +0000 (0:00:01.146) 0:00:33.691 ******* skipping: [localhost] TASK [Build TensorFlow for each Python version] ******************************** Friday 24 February 2023 01:56:38 +0000 (0:00:00.059) 0:00:33.751 ******* skipping: [localhost] => (item=3.8) skipping: [localhost] => (item=3.9) skipping: [localhost] => (item=3.10) skipping: [localhost] => (item=3.11) TASK [Build TensorFlow for each Python version (dual abi)] ********************* Friday 24 February 2023 01:56:38 +0000 (0:00:00.055) 0:00:33.807 ******* TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Friday 24 February 2023 01:56:38 +0000 (0:00:00.632) 0:00:34.439 ******* changed: [localhost] TASK [tensorflow_in_container : Remove TensorFlow-oneDNN-ACL git sources from previous build] *** Friday 24 February 2023 01:56:39 +0000 (0:00:00.828) 0:00:35.268 ******* skipping: [localhost] TASK [Fetch TensorFlow] ******************************************************** Friday 24 February 2023 01:56:39 +0000 (0:00:00.037) 0:00:35.306 ******* skipping: [localhost] TASK [(Python 3.8) patch TensorFlow tree] ************************************** Friday 24 February 2023 01:56:39 +0000 (0:00:00.037) 0:00:35.344 ******* TASK [tensorflow : Create linklibs shell script] ******************************* Friday 24 February 2023 01:56:39 +0000 (0:00:00.172) 0:00:35.516 ******* changed: [localhost] TASK [tensorflow : Create readme file about unit tests] ************************ Friday 24 February 2023 01:56:40 +0000 (0:00:00.692) 0:00:36.209 ******* changed: [localhost] TASK [tensorflow : Add to the copied files] ************************************ Friday 24 February 2023 01:56:41 +0000 (0:00:00.700) 0:00:36.909 ******* changed: [localhost] TASK [tensorflow : Add to the long_description in setup.py] ******************** Friday 24 February 2023 01:56:41 +0000 (0:00:00.596) 0:00:37.506 ******* changed: [localhost] TASK [tensorflow : Use nightly package requirements] *************************** Friday 24 February 2023 01:56:42 +0000 (0:00:00.581) 0:00:38.088 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) start build container] ************ Friday 24 February 2023 01:56:42 +0000 (0:00:00.392) 0:00:38.480 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir] *** Friday 24 February 2023 01:57:18 +0000 (0:00:35.153) 0:01:13.634 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for bazel cache] ****** Friday 24 February 2023 01:57:19 +0000 (0:00:01.227) 0:01:14.862 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for bazelisk cache] *** Friday 24 February 2023 01:57:20 +0000 (0:00:00.814) 0:01:15.677 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for pip cache] ******** Friday 24 February 2023 01:57:20 +0000 (0:00:00.822) 0:01:16.499 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) copy upper constraints] *********** Friday 24 February 2023 01:57:21 +0000 (0:00:00.788) 0:01:17.288 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) install Python packages] ********** Friday 24 February 2023 01:57:22 +0000 (0:00:00.718) 0:01:18.006 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git] *** Friday 24 February 2023 01:57:54 +0000 (0:00:31.677) 0:01:49.683 ******* fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- Extracting Bazel installation... Starting local Bazel server and connecting to it... INFO: Invocation ID: 8c55d19e-948a-4502-964f-50a104c0c7bf INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Reading rc options for 'build' from /usertools/aarch64.bazelrc: 'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/bin/python3 --action_env PYTHON_LIB_PATH=/usr/lib/tf_python --python_path=/usr/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --distinct_host_configuration=false --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3 INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64.bazelrc: --disk_cache=/tf/cache INFO: Found applicable config definition build:ambe in file /usertools/aarch64.bazelrc: --distinct_host_configuration=false --flaky_test_attempts=3 --action_env=PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin --host_crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --extra_toolchains=@ml2014_aarch64_config_aarch64//crosstool:toolchain-linux-aarch64 --extra_execution_platforms=@ml2014_aarch64_config_aarch64_platform//:platform --host_platform=@ml2014_aarch64_config_aarch64_platform//:platform --platforms=@ml2014_aarch64_config_aarch64_platform//:platform --repo_env=TF_PYTHON_CONFIG_REPO=@ml2014_aarch64_config_python INFO: Found applicable config definition build:mkl_aarch64_threadpool in file /tf/tensorflow/.bazelrc: --define=build_with_mkl_aarch64=true -c opt INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/tensorflow/… failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-p… failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured) WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/openxla/sta… failed: class java.io.FileNotFoundException GET returned 404 Not Found Analyzing: target //tensorflow/tools/pip_package:build_pip_package (289 packages loaded, 4306 targets configured) INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (593 packages loaded, 37030 targets configured). INFO: Found 1 target... [0 / 183] [Prepa] Creating source manifest for //tensorflow/lite/python:tflite_convert ... (5 actions, 0 running) [12,136 / 23,108] Compiling tensorflow/lite/delegates/xnnpack/quantization_util.cc; 11s local, remote-cache ... (111 actions, 110 running) [12,210 / 23,108] Compiling tensorflow/compiler/xla/literal_comparison.cc; 21s local, remote-cache ... (111 actions, 110 running) [12,294 / 23,108] Compiling tensorflow/compiler/xla/literal.cc; 36s local, remote-cache ... (111 actions, 110 running) [12,387 / 23,108] Compiling tensorflow/compiler/xla/literal.cc; 52s local, remote-cache ... (112 actions running) [12,622 / 23,108] Compiling tensorflow/compiler/xla/hlo/ir/hlo_instruction.cc; 38s local, remote-cache ... (112 actions running) [12,873 / 23,108] Compiling tensorflow/compiler/xla/service/memory_space_assignment.cc; 51s local, remote-cache ... (112 actions running) [13,013 / 23,108] Compiling tensorflow/compiler/xla/service/algebraic_simplifier.cc; 63s local, remote-cache ... (112 actions running) [13,169 / 23,108] Compiling tensorflow/python/client/tf_session_wrapper.cc; 55s local, remote-cache ... (112 actions running) [13,383 / 23,108] Compiling tensorflow/core/kernels/rnn/lstm_ops.cc; 66s local, remote-cache ... (112 actions running) [13,695 / 23,108] Compiling tensorflow/core/kernels/padding_fifo_queue.cc; 52s local, remote-cache ... (112 actions running) [13,919 / 23,108] Compiling tensorflow/core/kernels/lrn_op.cc; 66s local, remote-cache ... (112 actions running) [14,212 / 23,108] Compiling tensorflow/core/kernels/image/mirror_pad_op_cpu_impl_5.cc; 53s local, remote-cache ... (112 actions running) [14,634 / 23,108] Compiling tensorflow/core/kernels/training_ops.cc; 64s local, remote-cache ... (112 actions running) [17,905 / 24,452] Compiling tensorflow/core/kernels/training_ops.cc; 131s local, remote-cache ... (112 actions running) [18,516 / 24,452] Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 42s local, remote-cache ... (112 actions running) [18,910 / 24,452] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops.cc; 66s local, remote-cache ... (112 actions running) [19,369 / 24,452] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops.cc; 168s local, remote-cache ... (111 actions, 110 running) [19,627 / 24,452] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops.cc; 285s local, remote-cache ... (112 actions running) [19,805 / 24,452] Compiling tensorflow/core/kernels/cwise_op_select.cc; 181s local, remote-cache ... (112 actions running) [20,435 / 24,452] Compiling tensorflow/core/kernels/matmul_op_real.cc; 240s local, remote-cache ... (112 actions running) [21,299 / 24,452] Compiling tensorflow/core/kernels/matmul_op_real.cc; 418s local, remote-cache ... (112 actions running) [22,060 / 24,452] Compiling tensorflow/compiler/xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 135s local, remote-cache ... (112 actions running) [22,817 / 24,452] Compiling tensorflow/dtensor/mlir/expansions/iterator_spmd_expander.cc; 40s local, remote-cache ... (112 actions running) [24,042 / 24,484] Compiling tensorflow/dtensor/cc/dtensor_device.cc; 60s local, remote-cache ... (111 actions, 110 running) [24,592 / 24,659] Linking tensorflow/libtensorflow_cc.so.2.13.0; 161s local, remote-cache ERROR: /tf/tensorflow/tensorflow/BUILD:1635:19: Executing genrule //tensorflow:tf_python_api_gen_v2 failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped) Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/tools/api/generator/create_python_api.py", line 22, in <module> from tensorflow.python.tools.api.generator import doc_srcs File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/__init__.py", line 37, in <module> from tensorflow.python.eager import context File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/eager/context.py", line 28, in <module> from tensorflow.core.framework import function_pb2 File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/core/framework/function_pb2.py", line 5, in <module> from google.protobuf.internal import builder as _builder ModuleNotFoundError: No module named 'google.protobuf' Target //tensorflow/tools/pip_package:build_pip_package failed to build Use --verbose_failures to see the command lines of failed build steps. ERROR: /tf/tensorflow/tensorflow/python/tools/BUILD:282:10 Middleman _middlemen/tensorflow_Spython_Stools_Sprint_Uselective_Uregistration_Uheader-runfiles failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped) INFO: Elapsed time: 2802.608s, Critical Path: 1106.80s INFO: 24658 processes: 11508 disk cache hit, 5600 internal, 7550 local. FAILED: Build did NOT complete successfully FAILED: Build did NOT complete successfully stderr_lines: <omitted> stdout: '' stdout_lines: <omitted> PLAY RECAP ********************************************************************* localhost : ok=27 changed=20 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0 Friday 24 February 2023 02:44:37 +0000 (0:46:43.868) 0:48:33.552 ******* =============================================================================== tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git 2803.87s tensorflow_in_container : (Python 3.8) start build container ----------- 35.15s tensorflow_in_container : (Python 3.8) install Python packages --------- 31.68s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 21.97s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.45s Gathering Facts --------------------------------------------------------- 2.63s Create cache dirs ------------------------------------------------------- 1.40s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.23s tensorflow : Save git commit hash to file ------------------------------- 1.15s tensorflow_in_container : Reset checkout to clean state ----------------- 0.83s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.82s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.81s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.79s tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.72s tensorflow : Create readme file about unit tests ------------------------ 0.70s tensorflow : Create linklibs shell script ------------------------------- 0.69s Build TensorFlow for each Python version (dual abi) --------------------- 0.63s tensorflow : Add to the copied files ------------------------------------ 0.60s tensorflow : Get oneline version of git log for this checkout ----------- 0.59s Build step 'Execute shell' marked build as failure

1 year, 9 months

1
2
0 0

Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #703

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/703/disp…> Changes: ------------------------------------------ [...truncated 1002.74 KB...] Stats over 20 runs: max = 5.5s, min = 2.7s, avg = 3.4s, dev = 0.7s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 6.5s Stats over 20 runs: max = 6.5s, min = 3.0s, avg = 4.7s, dev = 1.0s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 11.3s Stats over 20 runs: max = 11.3s, min = 3.1s, avg = 5.5s, dev = 1.7s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 11.3s Stats over 20 runs: max = 11.3s, min = 3.6s, avg = 5.2s, dev = 1.7s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 6.2s Stats over 20 runs: max = 6.2s, min = 5.4s, avg = 5.7s, dev = 0.2s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 12.1s Stats over 20 runs: max = 12.1s, min = 9.0s, avg = 10.6s, dev = 0.8s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 9.4s Stats over 20 runs: max = 9.4s, min = 8.2s, avg = 8.8s, dev = 0.4s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 42.5s Stats over 20 runs: max = 42.5s, min = 6.8s, avg = 15.3s, dev = 11.0s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 15.4s Stats over 20 runs: max = 15.4s, min = 9.5s, avg = 11.4s, dev = 1.8s //tensorflow/python/kernel_tests:metrics_test PASSED in 33.0s Stats over 20 runs: max = 33.0s, min = 4.8s, avg = 15.2s, dev = 8.2s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 5.4s Stats over 20 runs: max = 5.4s, min = 2.5s, avg = 3.2s, dev = 0.7s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 12.0s Stats over 20 runs: max = 12.0s, min = 2.4s, avg = 4.6s, dev = 2.5s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 40.7s Stats over 20 runs: max = 40.7s, min = 2.8s, avg = 12.3s, dev = 12.3s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 94.0s Stats over 20 runs: max = 94.0s, min = 23.5s, avg = 48.9s, dev = 18.6s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 5.7s Stats over 20 runs: max = 5.7s, min = 3.0s, avg = 4.3s, dev = 1.0s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 13.5s Stats over 20 runs: max = 13.5s, min = 6.3s, avg = 9.5s, dev = 2.0s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 150.4s Stats over 20 runs: max = 150.4s, min = 32.6s, avg = 82.4s, dev = 35.8s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 17.8s Stats over 20 runs: max = 17.8s, min = 3.0s, avg = 8.0s, dev = 5.0s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 16.9s Stats over 20 runs: max = 16.9s, min = 4.1s, avg = 9.9s, dev = 4.5s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 16.4s Stats over 20 runs: max = 16.4s, min = 13.6s, avg = 15.2s, dev = 0.8s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 60.0s Stats over 20 runs: max = 60.0s, min = 4.0s, avg = 24.9s, dev = 19.5s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 18.1s Stats over 20 runs: max = 18.1s, min = 2.7s, avg = 5.5s, dev = 3.4s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 18.6s Stats over 24 runs: max = 18.6s, min = 6.7s, avg = 12.2s, dev = 3.0s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 19.8s Stats over 24 runs: max = 19.8s, min = 6.3s, avg = 12.1s, dev = 3.6s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 20.2s Stats over 24 runs: max = 20.2s, min = 6.5s, avg = 10.8s, dev = 4.1s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 6.8s Stats over 25 runs: max = 6.8s, min = 5.7s, avg = 6.0s, dev = 0.2s //tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 33.6s Stats over 25 runs: max = 33.6s, min = 6.8s, avg = 11.0s, dev = 6.7s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 7.5s Stats over 30 runs: max = 7.5s, min = 6.5s, avg = 7.0s, dev = 0.3s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 12.2s Stats over 30 runs: max = 12.2s, min = 10.5s, avg = 11.2s, dev = 0.4s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 6.8s Stats over 30 runs: max = 6.8s, min = 5.6s, avg = 6.1s, dev = 0.3s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 6.6s Stats over 30 runs: max = 6.6s, min = 5.7s, avg = 6.1s, dev = 0.2s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 15.7s Stats over 30 runs: max = 15.7s, min = 2.8s, avg = 6.3s, dev = 3.0s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 7.0s Stats over 31 runs: max = 7.0s, min = 5.9s, avg = 6.4s, dev = 0.2s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 9.1s Stats over 32 runs: max = 9.1s, min = 5.9s, avg = 6.6s, dev = 0.7s //tensorflow/python/data/experimental/kernel_tests/service:auto_shard_test PASSED in 14.4s Stats over 32 runs: max = 14.4s, min = 3.1s, avg = 9.0s, dev = 2.9s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 26.3s Stats over 32 runs: max = 26.3s, min = 6.7s, avg = 15.1s, dev = 4.5s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 8.5s Stats over 40 runs: max = 8.5s, min = 6.1s, avg = 7.3s, dev = 0.9s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 7.6s Stats over 40 runs: max = 7.6s, min = 5.8s, avg = 6.5s, dev = 0.4s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 8.4s Stats over 40 runs: max = 8.4s, min = 6.6s, avg = 7.5s, dev = 0.4s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 9.0s Stats over 40 runs: max = 9.0s, min = 6.2s, avg = 7.1s, dev = 0.6s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 83.5s Stats over 50 runs: max = 83.5s, min = 16.2s, avg = 36.8s, dev = 24.1s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 35.8s Stats over 50 runs: max = 35.8s, min = 2.4s, avg = 9.7s, dev = 7.4s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 38.2s Stats over 50 runs: max = 38.2s, min = 2.5s, avg = 9.3s, dev = 7.7s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 9.2s Stats over 50 runs: max = 9.2s, min = 6.2s, avg = 6.9s, dev = 0.6s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 9.8s Stats over 50 runs: max = 9.8s, min = 8.1s, avg = 8.9s, dev = 0.4s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 13.2s Stats over 50 runs: max = 13.2s, min = 7.9s, avg = 9.8s, dev = 1.1s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 21.5s Stats over 50 runs: max = 21.5s, min = 5.4s, avg = 10.6s, dev = 3.7s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 5.6s Stats over 50 runs: max = 5.6s, min = 2.5s, avg = 3.4s, dev = 0.8s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 5.5s Stats over 50 runs: max = 5.5s, min = 2.6s, avg = 3.1s, dev = 0.6s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 29.1s Stats over 50 runs: max = 29.1s, min = 6.4s, avg = 14.4s, dev = 5.6s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 11.2s Stats over 50 runs: max = 11.2s, min = 2.8s, avg = 3.9s, dev = 1.2s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 10.1s Stats over 50 runs: max = 10.1s, min = 2.5s, avg = 3.9s, dev = 2.0s Executed 3602 out of 3602 tests: 3599 tests pass and 3 fail locally. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages] *** Saturday 25 February 2023 11:15:05 +0000 (1:08:03.515) 2:01:48.106 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) save list of installed Python packages] *** Saturday 25 February 2023 11:15:07 +0000 (0:00:01.965) 2:01:50.072 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) save tests output to file] ******** Saturday 25 February 2023 11:15:08 +0000 (0:00:00.695) 2:01:50.767 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) save tests stderr output to file] *** Saturday 25 February 2023 11:15:08 +0000 (0:00:00.708) 2:01:51.475 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) Extract number of tests run] ****** Saturday 25 February 2023 11:15:09 +0000 (0:00:00.698) 2:01:52.174 ***** ok: [localhost] TASK [tensorflow_in_container : (Python 3.8) Show number of tests run] ********* Saturday 25 February 2023 11:15:09 +0000 (0:00:00.102) 2:01:52.276 ***** ok: [localhost] => ut_tests_line: '' TASK [tensorflow_in_container : (Python 3.8) Extract failed tests] ************* Saturday 25 February 2023 11:15:09 +0000 (0:00:00.046) 2:01:52.323 ***** ok: [localhost] TASK [tensorflow_in_container : (Python 3.8) Show which tests failed] ********** Saturday 25 February 2023 11:15:09 +0000 (0:00:00.104) 2:01:52.427 ***** ok: [localhost] => tests_failed: 'FAILED: ' TASK [tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one] *** Saturday 25 February 2023 11:15:09 +0000 (0:00:00.048) 2:01:52.476 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) Get list of wheel files] ********** Saturday 25 February 2023 11:22:45 +0000 (0:07:35.971) 2:09:28.447 ***** ok: [localhost] TASK [tensorflow_in_container : (Python 3.8) Get filename of latest wheel] ***** Saturday 25 February 2023 11:22:46 +0000 (0:00:00.602) 2:09:29.050 ***** ok: [localhost] TASK [tensorflow_in_container : (Python 3.8) move manylinux2014 wheel outside] *** Saturday 25 February 2023 11:22:46 +0000 (0:00:00.067) 2:09:29.118 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) Remove manylinux2014 wheel] ******* Saturday 25 February 2023 11:22:48 +0000 (0:00:02.368) 2:09:31.486 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) stop build container] ************* Saturday 25 February 2023 11:22:49 +0000 (0:00:00.422) 2:09:31.908 ***** changed: [localhost] TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Saturday 25 February 2023 11:26:25 +0000 (0:03:35.878) 2:13:07.787 ***** changed: [localhost] TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] *** Saturday 25 February 2023 11:26:25 +0000 (0:00:00.639) 2:13:08.426 ***** skipping: [localhost] TASK [Fetch TensorFlow] ******************************************************** Saturday 25 February 2023 11:26:25 +0000 (0:00:00.039) 2:13:08.466 ***** skipping: [localhost] TASK [(Python 3.9) patch TensorFlow tree] ************************************** Saturday 25 February 2023 11:26:25 +0000 (0:00:00.039) 2:13:08.506 ***** TASK [tensorflow : Create linklibs shell script] ******************************* Saturday 25 February 2023 11:26:26 +0000 (0:00:00.176) 2:13:08.682 ***** changed: [localhost] TASK [tensorflow : Create readme file about unit tests] ************************ Saturday 25 February 2023 11:26:26 +0000 (0:00:00.699) 2:13:09.381 ***** changed: [localhost] TASK [tensorflow : Add to the copied files] ************************************ Saturday 25 February 2023 11:26:27 +0000 (0:00:00.703) 2:13:10.085 ***** changed: [localhost] TASK [tensorflow : Add to the long_description in setup.py] ******************** Saturday 25 February 2023 11:26:27 +0000 (0:00:00.370) 2:13:10.455 ***** changed: [localhost] TASK [tensorflow : Use nightly package requirements] *************************** Saturday 25 February 2023 11:26:28 +0000 (0:00:00.364) 2:13:10.820 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.9) copy upper constraints] *********** Saturday 25 February 2023 11:26:28 +0000 (0:00:00.395) 2:13:11.215 ***** ok: [localhost] TASK [tensorflow_in_container : (Python 3.9) copy upper-constraints to within Docker context] *** Saturday 25 February 2023 11:26:29 +0000 (0:00:00.764) 2:13:11.979 ***** fatal: [localhost]: FAILED! => changed=true cmd: - cp - <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/wheel…> - <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/confi…> delta: '0:00:00.003706' end: '2023-02-25 11:26:29.715211' msg: non-zero return code rc: 1 start: '2023-02-25 11:26:29.711505' stderr: 'cp: cannot create regular file ''<https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/confi…''>: Permission denied' stderr_lines: <omitted> stdout: '' stdout_lines: <omitted> PLAY RECAP ********************************************************************* localhost : ok=54 changed=40 unreachable=0 failed=1 skipped=10 rescued=0 ignored=1 Saturday 25 February 2023 11:26:29 +0000 (0:00:00.344) 2:13:12.324 ***** =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow git tests ------ 4083.52s tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 3038.86s tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one - 455.97s tensorflow_in_container : (Python 3.8) stop build container ----------- 215.88s tensorflow_in_container : (Python 3.8) build Python package ------------ 96.26s tensorflow_in_container : (Python 3.8) build Python versioned container -- 42.89s tensorflow : Fetch TensorFlow from git --------------------------------- 21.49s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.79s Gathering Facts --------------------------------------------------------- 2.62s tensorflow_in_container : (Python 3.8) move manylinux2014 wheel outside --- 2.37s tensorflow_in_container : (Python 3.8) collect list of installed Python packages --- 1.97s tensorflow_in_container : (Python 3.8) start build container ------------ 1.93s tensorflow : Create readme file about unit tests ------------------------ 1.41s Create cache dirs ------------------------------------------------------- 1.40s tensorflow : Create linklibs shell script ------------------------------- 1.39s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.26s tensorflow : Save git commit hash to file ------------------------------- 1.12s tensorflow : Add to the copied files ------------------------------------ 0.93s tensorflow : Add to the long_description in setup.py -------------------- 0.92s Build step 'Execute shell' marked build as failure

1 year, 9 months

1
1
0 0

Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #701

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/701/disp…> Changes: ------------------------------------------ [...truncated 6.55 KB...] skipping: [localhost] => (item={'key': '2.9', 'value': {'tensorflow_version': '2.9.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.9.0', 'tensorboard_version': '==2.9.0', 'tensorflow_estimator_version': '==2.9.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.8', 'value': {'tensorflow_version': '2.8.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.8.0', 'tensorboard_version': '==2.8.0', 'tensorflow_estimator_version': '==2.8.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/mlir/lite/tests:prepare-tf.mlir.test', '//tensorflow/compiler/mlir/tensorflow:dump_graph_test', '//tensorflow/core/common_runtime:direct_session_test', '//tensorflow/core/common_runtime:direct_session_with_debug_test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:quantize_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python:quantized_ops_test', '//tensorflow/python:script_ops_test', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.7', 'value': {'tensorflow_version': '2.7.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.5', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.7.0', 'tensorboard_version': '==2.7.0', 'tensorflow_estimator_version': '==2.7.0', 'python_install_packages': ['portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/java/...', '//tensorflow/lite/...', '//tensorflow/compiler/xla/python/...', '//tensorflow/compiler/xla/service/cpu/...', '//tensorflow/compiler/xla/tests/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/core/kernels:sparse_matmul_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/debug/cli:debugger_cli_common_test', '//tensorflow/python/debug/examples/v2:examples_v2_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/keras/mixed_precision:model_test', '//tensorflow/python/keras/preprocessing:image_test', '//tensorflow/python/kernel_tests:init_ops_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests:self_adjoint_eig_op_test', '//tensorflow/python/kernel_tests:sparse_matmul_op_test', '//tensorflow/python/lib/io:file_io_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python/ops/ragged:ragged_print_op_test', '//tensorflow/python/profiler/integration_test:profiler_api_test', '//tensorflow/python/profiler:profiler_v2_test', '//tensorflow/python/util:dispatch_test', '//tensorflow/python/util:traceback_utils_test', '//tensorflow/tools/api/tests:api_compatibility_test', '//tensorflow/tools/docs:tf_doctest', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.6', 'value': {'tensorflow_version': '2.6.5', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.6.0', 'tensorboard_version': '==2.6.0', 'tensorflow_estimator_version': '==2.6.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.5', 'value': {'tensorflow_version': '2.5.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.34.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.5.0', 'tensorboard_version': '==2.5.0', 'tensorflow_estimator_version': '==2.5.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.4', 'value': {'tensorflow_version': '2.4.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.3.3', 'grpcio_version': '~=1.32.0', 'h5py_version': '~=2.10', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.4.3', 'tensorboard_version': '==2.4.1', 'tensorflow_estimator_version': '==2.4.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '1.15', 'value': {'tensorflow_version': '1.15.5', 'bazel_version': '0.29.1', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.2.2', 'grpcio_version': '~=1.32.0', 'h5py_version': '==2.10', 'numpy_version': '~=1.18.0', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==1.2.2', 'tensorboard_version': '==1.15.0', 'tensorflow_estimator_version': '==1.15.2', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m']}}) TASK [tensorflow : Set TensorFlow and other package versions] ****************** Thursday 23 February 2023 18:10:09 +0000 (0:00:00.279) 0:00:04.653 ***** ok: [localhost] TASK [tensorflow : Set build dir for TensorFlow git] *************************** Thursday 23 February 2023 18:10:09 +0000 (0:00:00.083) 0:00:04.737 ***** ok: [localhost] TASK [tensorflow : Remove TensorFlow git sources from previous build] ********** Thursday 23 February 2023 18:10:09 +0000 (0:00:00.045) 0:00:04.782 ***** changed: [localhost] TASK [tensorflow : Fetch TensorFlow] ******************************************* Thursday 23 February 2023 18:10:12 +0000 (0:00:03.655) 0:00:08.438 ***** included: <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/confi…> for localhost TASK [tensorflow : Fetch TensorFlow git source] ******************************** Thursday 23 February 2023 18:10:13 +0000 (0:00:00.116) 0:00:08.554 ***** skipping: [localhost] TASK [tensorflow : Unpack TensorFlow git source] ******************************* Thursday 23 February 2023 18:10:13 +0000 (0:00:00.041) 0:00:08.595 ***** skipping: [localhost] TASK [tensorflow : Rename source dir for oneDNN build] ************************* Thursday 23 February 2023 18:10:13 +0000 (0:00:00.037) 0:00:08.633 ***** skipping: [localhost] TASK [tensorflow : Fetch TensorFlow from git] ********************************** Thursday 23 February 2023 18:10:13 +0000 (0:00:00.040) 0:00:08.673 ***** changed: [localhost] TASK [tensorflow : Fetch TensorFlow from git at commit] ************************ Thursday 23 February 2023 18:10:35 +0000 (0:00:22.485) 0:00:31.159 ***** skipping: [localhost] TASK [tensorflow : Set world write access to source] *************************** Thursday 23 February 2023 18:10:35 +0000 (0:00:00.037) 0:00:31.197 ***** changed: [localhost] TASK [tensorflow : Get oneline version of git log for this checkout] *********** Thursday 23 February 2023 18:10:36 +0000 (0:00:00.374) 0:00:31.571 ***** changed: [localhost] TASK [tensorflow : Show git log] *********************************************** Thursday 23 February 2023 18:10:36 +0000 (0:00:00.584) 0:00:32.156 ***** ok: [localhost] => git_log.stdout: 62dcf7e02c0dae336bfb54aa83a03ddd22ccc9af Set up step id in c_api_tfrt TASK [tensorflow : Record git commit hash to variable] ************************* Thursday 23 February 2023 18:10:36 +0000 (0:00:00.044) 0:00:32.200 ***** ok: [localhost] TASK [tensorflow : Save git commit hash to file] ******************************* Thursday 23 February 2023 18:10:36 +0000 (0:00:00.085) 0:00:32.286 ***** changed: [localhost] TASK [Build Bazel] ************************************************************* Thursday 23 February 2023 18:10:37 +0000 (0:00:01.115) 0:00:33.401 ***** skipping: [localhost] TASK [Build TensorFlow for each Python version] ******************************** Thursday 23 February 2023 18:10:37 +0000 (0:00:00.037) 0:00:33.439 ***** skipping: [localhost] => (item=3.8) skipping: [localhost] => (item=3.9) skipping: [localhost] => (item=3.10) skipping: [localhost] => (item=3.11) TASK [Build TensorFlow for each Python version (dual abi)] ********************* Thursday 23 February 2023 18:10:38 +0000 (0:00:00.055) 0:00:33.494 ***** TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Thursday 23 February 2023 18:10:38 +0000 (0:00:00.632) 0:00:34.126 ***** changed: [localhost] TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] *** Thursday 23 February 2023 18:10:39 +0000 (0:00:00.632) 0:00:34.759 ***** skipping: [localhost] TASK [Fetch TensorFlow] ******************************************************** Thursday 23 February 2023 18:10:39 +0000 (0:00:00.037) 0:00:34.796 ***** skipping: [localhost] TASK [(Python 3.8) patch TensorFlow tree] ************************************** Thursday 23 February 2023 18:10:39 +0000 (0:00:00.039) 0:00:34.835 ***** TASK [tensorflow : Create linklibs shell script] ******************************* Thursday 23 February 2023 18:10:39 +0000 (0:00:00.152) 0:00:34.988 ***** changed: [localhost] TASK [tensorflow : Create readme file about unit tests] ************************ Thursday 23 February 2023 18:10:40 +0000 (0:00:00.691) 0:00:35.679 ***** changed: [localhost] TASK [tensorflow : Add to the copied files] ************************************ Thursday 23 February 2023 18:10:40 +0000 (0:00:00.726) 0:00:36.406 ***** changed: [localhost] TASK [tensorflow : Add to the long_description in setup.py] ******************** Thursday 23 February 2023 18:10:41 +0000 (0:00:00.563) 0:00:36.970 ***** changed: [localhost] TASK [tensorflow : Use nightly package requirements] *************************** Thursday 23 February 2023 18:10:42 +0000 (0:00:00.552) 0:00:37.522 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) start build container] ************ Thursday 23 February 2023 18:10:42 +0000 (0:00:00.392) 0:00:37.914 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir] *** Thursday 23 February 2023 18:10:45 +0000 (0:00:03.400) 0:00:41.314 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for bazel cache] ****** Thursday 23 February 2023 18:10:47 +0000 (0:00:01.223) 0:00:42.538 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for bazelisk cache] *** Thursday 23 February 2023 18:10:47 +0000 (0:00:00.843) 0:00:43.381 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for pip cache] ******** Thursday 23 February 2023 18:10:48 +0000 (0:00:00.828) 0:00:44.209 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) copy upper constraints] *********** Thursday 23 February 2023 18:10:49 +0000 (0:00:00.817) 0:00:45.026 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) install Python packages] ********** Thursday 23 February 2023 18:10:50 +0000 (0:00:00.717) 0:00:45.743 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) build TensorFlow git] ************* Thursday 23 February 2023 18:11:20 +0000 (0:00:30.583) 0:01:16.327 ***** fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- Extracting Bazel installation... Starting local Bazel server and connecting to it... INFO: Invocation ID: 5273ec2c-5594-420a-b0c1-20ca14e4ddb5 INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Reading rc options for 'build' from /usertools/aarch64.bazelrc: 'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/bin/python3 --action_env PYTHON_LIB_PATH=/usr/lib/tf_python --python_path=/usr/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --distinct_host_configuration=false --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3 INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64.bazelrc: --disk_cache=/tf/cache INFO: Found applicable config definition build:ambe in file /usertools/aarch64.bazelrc: --distinct_host_configuration=false --flaky_test_attempts=3 --action_env=PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin --host_crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --extra_toolchains=@ml2014_aarch64_config_aarch64//crosstool:toolchain-linux-aarch64 --extra_execution_platforms=@ml2014_aarch64_config_aarch64_platform//:platform --host_platform=@ml2014_aarch64_config_aarch64_platform//:platform --platforms=@ml2014_aarch64_config_aarch64_platform//:platform --repo_env=TF_PYTHON_CONFIG_REPO=@ml2014_aarch64_config_python INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured) Analyzing: target //tensorflow/tools/pip_package:build_pip_package (287 packages loaded, 4244 targets configured) INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (590 packages loaded, 33778 targets configured). INFO: Found 1 target... [0 / 119] [Prepa] Expanding template tensorflow/lite/python/tflite_convert ... (5 actions, 0 running) [12,976 / 16,049] Compiling tensorflow/lite/kernels/register_ref.cc; 1s local, remote-cache ... (63 actions, 30 running) [12,987 / 16,049] Compiling tensorflow/compiler/xla/translate/hlo_to_mhlo/hlo_utils.cc; 11s local, remote-cache ... (112 actions running) [13,048 / 16,049] Compiling tensorflow/compiler/xla/translate/hlo_to_mhlo/hlo_utils.cc; 22s local, remote-cache ... (112 actions running) [13,554 / 16,049] Compiling tensorflow/compiler/xla/translate/hlo_to_mhlo/hlo_function_importer.cc; 35s local, remote-cache ... (112 actions running) [13,600 / 16,049] Compiling tensorflow/compiler/xla/service/cpu/ir_emitter.cc; 49s local, remote-cache ... (112 actions running) [13,635 / 16,049] Compiling tensorflow/compiler/xla/service/cpu/cpu_compiler.cc; 66s local, remote-cache ... (112 actions running) [13,685 / 16,049] Compiling tensorflow/compiler/xla/service/cpu/cpu_compiler.cc; 85s local, remote-cache ... (112 actions running) [13,741 / 16,049] Compiling tensorflow/core/kernels/scatter_nd_op.cc; 60s local, remote-cache ... (112 actions running) [13,784 / 16,049] Compiling tensorflow/core/kernels/scatter_nd_op.cc; 85s local, remote-cache ... (112 actions running) [13,856 / 16,049] Compiling tensorflow/core/kernels/scatter_nd_op.cc; 114s local, remote-cache ... (112 actions running) [13,957 / 16,049] Compiling tensorflow/core/kernels/pad_op.cc; 139s local, remote-cache ... (112 actions running) [14,010 / 16,049] Compiling tensorflow/core/kernels/pad_op.cc; 177s local, remote-cache ... (112 actions running) [14,079 / 16,049] Compiling tensorflow/core/kernels/linalg/svd_op_complex64.cc; 152s local, remote-cache ... (112 actions running) [14,221 / 16,049] Compiling tensorflow/core/kernels/linalg/matrix_square_root_op.cc; 194s local, remote-cache ... (112 actions running) [14,521 / 16,049] Compiling tensorflow/core/kernels/linalg/matrix_square_root_op.cc; 253s local, remote-cache ... (112 actions running) [14,684 / 16,049] Compiling tensorflow/core/kernels/linalg/matrix_square_root_op.cc; 321s local, remote-cache ... (112 actions running) [14,829 / 16,049] Compiling tensorflow/core/kernels/matmul_op_real.cc; 365s local, remote-cache ... (110 actions, 108 running) [14,975 / 16,049] Compiling tensorflow/core/kernels/matmul_op_real.cc; 454s local, remote-cache ... (112 actions running) [15,169 / 16,049] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 107s local, remote-cache ... (112 actions running) [19,303 / 19,822] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops.cc; 222s local, remote-cache ... (112 actions running) [23,441 / 23,561] Compiling tensorflow/core/kernels/conv_ops.cc; 217s local, remote-cache ... (56 actions running) [23,492 / 23,561] Compiling tensorflow/core/kernels/conv_ops.cc; 373s local, remote-cache [23,494 / 23,561] Linking tensorflow/libtensorflow_cc.so.2.13.0; 58s local, remote-cache [23,494 / 23,561] Linking tensorflow/libtensorflow_cc.so.2.13.0; 264s local, remote-cache [23,494 / 23,561] Linking tensorflow/libtensorflow_cc.so.2.13.0; 501s local, remote-cache ERROR: /tf/tensorflow/tensorflow/BUILD:1635:19: Executing genrule //tensorflow:tf_python_api_gen_v2 failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped) Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/tools/api/generator/create_python_api.py", line 22, in <module> from tensorflow.python.tools.api.generator import doc_srcs File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/__init__.py", line 37, in <module> from tensorflow.python.eager import context File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/eager/context.py", line 28, in <module> from tensorflow.core.framework import function_pb2 File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/core/framework/function_pb2.py", line 5, in <module> from google.protobuf.internal import builder as _builder ModuleNotFoundError: No module named 'google.protobuf' Target //tensorflow/tools/pip_package:build_pip_package failed to build Use --verbose_failures to see the command lines of failed build steps. ERROR: /tf/tensorflow/tensorflow/tools/pip_package/BUILD:276:10 Middleman _middlemen/tensorflow_Stools_Spip_Upackage_Sbuild_Upip_Upackage-runfiles failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped) INFO: Elapsed time: 1951.697s, Critical Path: 1123.49s INFO: 23560 processes: 15975 disk cache hit, 5544 internal, 2041 local. FAILED: Build did NOT complete successfully FAILED: Build did NOT complete successfully stderr_lines: <omitted> stdout: '' stdout_lines: <omitted> PLAY RECAP ********************************************************************* localhost : ok=27 changed=20 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0 Thursday 23 February 2023 18:43:53 +0000 (0:32:32.862) 0:33:49.190 ***** =============================================================================== tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 1952.86s tensorflow_in_container : (Python 3.8) install Python packages --------- 30.58s tensorflow : Fetch TensorFlow from git --------------------------------- 22.49s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.66s tensorflow_in_container : (Python 3.8) start build container ------------ 3.40s Gathering Facts --------------------------------------------------------- 1.61s Create cache dirs ------------------------------------------------------- 1.38s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.22s tensorflow : Save git commit hash to file ------------------------------- 1.12s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.84s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.83s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.82s tensorflow : Create readme file about unit tests ------------------------ 0.73s tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.72s tensorflow : Create linklibs shell script ------------------------------- 0.69s Build TensorFlow for each Python version (dual abi) --------------------- 0.63s tensorflow_in_container : Reset checkout to clean state ----------------- 0.63s tensorflow : Get oneline version of git log for this checkout ----------- 0.58s tensorflow : Add to the copied files ------------------------------------ 0.56s Build step 'Execute shell' marked build as failure

1 year, 10 months

1
0
0 0

Build failed in Jenkins: Tensorflow oneDNN Python package (manylinux2014 nightly) #341

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/3…> Changes: ------------------------------------------ [...truncated 32.00 MB...] //tensorflow/python:nn_fused_batchnorm_d9m_test_cpu PASSED in 13.1s Stats over 4 runs: max = 13.1s, min = 12.7s, avg = 13.0s, dev = 0.2s //tensorflow/python/data/experimental/kernel_tests:parse_example_dataset_test PASSED in 23.0s Stats over 4 runs: max = 23.0s, min = 10.9s, avg = 17.1s, dev = 5.8s //tensorflow/python/data/experimental/kernel_tests:sql_dataset_test PASSED in 24.2s Stats over 4 runs: max = 24.2s, min = 19.5s, avg = 22.0s, dev = 1.8s //tensorflow/python/data/experimental/kernel_tests/service:cross_trainer_cache_ft_test PASSED in 6.9s Stats over 4 runs: max = 6.9s, min = 5.8s, avg = 6.4s, dev = 0.5s //tensorflow/python/data/kernel_tests:batch_test PASSED in 30.8s Stats over 4 runs: max = 30.8s, min = 21.4s, avg = 25.1s, dev = 3.5s //tensorflow/python/data/kernel_tests:fixed_length_record_dataset_test PASSED in 16.6s Stats over 4 runs: max = 16.6s, min = 7.6s, avg = 12.2s, dev = 4.1s //tensorflow/python/data/kernel_tests:ragged_batch_test PASSED in 17.0s Stats over 4 runs: max = 17.0s, min = 14.5s, avg = 16.1s, dev = 1.0s //tensorflow/python/data/kernel_tests:shuffle_test PASSED in 31.1s Stats over 4 runs: max = 31.1s, min = 22.4s, avg = 26.5s, dev = 3.3s //tensorflow/python/debug/lib:dumping_callback_test_cpu PASSED in 15.2s Stats over 4 runs: max = 15.2s, min = 14.1s, avg = 14.7s, dev = 0.5s //tensorflow/python/distribute:cross_device_ops_test_cpu PASSED in 27.6s Stats over 4 runs: max = 27.6s, min = 19.1s, avg = 23.5s, dev = 3.4s //tensorflow/python/distribute:strategy_gather_test_2gpu PASSED in 22.1s Stats over 4 runs: max = 22.1s, min = 12.2s, avg = 17.3s, dev = 4.7s //tensorflow/python/distribute:strategy_gather_test_cpu PASSED in 24.4s Stats over 4 runs: max = 24.4s, min = 13.3s, avg = 18.7s, dev = 5.4s //tensorflow/python/kernel_tests:collective_ops_test_2gpu PASSED in 32.7s Stats over 4 runs: max = 32.7s, min = 29.9s, avg = 31.2s, dev = 1.1s //tensorflow/python/kernel_tests:collective_ops_test_cpu PASSED in 31.1s Stats over 4 runs: max = 31.1s, min = 30.0s, avg = 30.5s, dev = 0.5s //tensorflow/python/kernel_tests/array_ops:concat_op_test_cpu PASSED in 12.9s Stats over 4 runs: max = 12.9s, min = 10.9s, avg = 11.8s, dev = 0.8s //tensorflow/python/kernel_tests/random:random_gamma_test_cpu PASSED in 71.7s Stats over 4 runs: max = 71.7s, min = 6.3s, avg = 34.1s, dev = 28.5s //tensorflow/python/kernel_tests/signal:window_ops_test_cpu PASSED in 14.6s Stats over 4 runs: max = 14.6s, min = 14.2s, avg = 14.3s, dev = 0.1s //tensorflow/python/ops/ragged:ragged_getitem_test PASSED in 43.4s Stats over 4 runs: max = 43.4s, min = 40.1s, avg = 41.9s, dev = 1.2s //tensorflow/compiler/tests:conv3d_test_cpu PASSED in 13.2s Stats over 5 runs: max = 13.2s, min = 2.8s, avg = 7.5s, dev = 3.9s //tensorflow/compiler/tests:depthwise_conv_op_test_cpu PASSED in 13.9s Stats over 5 runs: max = 13.9s, min = 6.4s, avg = 9.8s, dev = 2.9s //tensorflow/compiler/tests:repeat_op_test_cpu PASSED in 6.4s Stats over 5 runs: max = 6.4s, min = 4.7s, avg = 5.3s, dev = 0.6s //tensorflow/compiler/tests:repeat_op_test_cpu_mlir_bridge_test PASSED in 6.3s Stats over 5 runs: max = 6.3s, min = 3.8s, avg = 4.8s, dev = 0.9s //tensorflow/python/distribute:mirrored_strategy_test_2gpu PASSED in 10.2s Stats over 5 runs: max = 10.2s, min = 8.3s, avg = 9.0s, dev = 0.7s //tensorflow/python/distribute:mirrored_strategy_test_cpu PASSED in 9.3s Stats over 5 runs: max = 9.3s, min = 7.7s, avg = 8.4s, dev = 0.6s //tensorflow/python/eager:forwardprop_test_cpu PASSED in 94.7s Stats over 5 runs: max = 94.7s, min = 13.6s, avg = 41.5s, dev = 27.9s //tensorflow/python/eager/polymorphic_function:gradients_test_cpu PASSED in 12.7s Stats over 5 runs: max = 12.7s, min = 8.1s, avg = 10.1s, dev = 1.8s //tensorflow/python/kernel_tests/linalg:cholesky_op_test_cpu PASSED in 67.7s Stats over 5 runs: max = 67.7s, min = 32.9s, avg = 43.4s, dev = 12.8s //tensorflow/python/kernel_tests/linalg:linear_operator_composition_test_cpu PASSED in 39.8s Stats over 5 runs: max = 39.8s, min = 37.4s, avg = 38.9s, dev = 1.0s //tensorflow/python/kernel_tests/linalg:linear_operator_diag_test_cpu PASSED in 22.8s Stats over 5 runs: max = 22.8s, min = 21.8s, avg = 22.4s, dev = 0.3s //tensorflow/python/kernel_tests/linalg:linear_operator_householder_test_cpu PASSED in 21.1s Stats over 5 runs: max = 21.1s, min = 18.2s, avg = 19.5s, dev = 1.1s //tensorflow/python/kernel_tests/linalg:linear_operator_permutation_test_cpu PASSED in 29.3s Stats over 5 runs: max = 29.3s, min = 27.9s, avg = 28.8s, dev = 0.5s //tensorflow/python/kernel_tests/linalg:linear_operator_toeplitz_test_cpu PASSED in 13.7s Stats over 5 runs: max = 13.7s, min = 11.0s, avg = 11.9s, dev = 1.0s //tensorflow/python/kernel_tests/linalg:linear_operator_tridiag_test_cpu PASSED in 81.2s Stats over 5 runs: max = 81.2s, min = 77.1s, avg = 78.4s, dev = 1.5s //tensorflow/python/kernel_tests/nn_ops:fractional_max_pool_op_test PASSED in 11.8s Stats over 5 runs: max = 11.8s, min = 2.7s, avg = 5.6s, dev = 3.3s //tensorflow/python/ops/parallel_for:math_test_cpu PASSED in 71.0s Stats over 5 runs: max = 71.0s, min = 23.9s, avg = 42.9s, dev = 16.9s //tensorflow/compiler/tests:scan_ops_test_cpu_mlir_bridge_test PASSED in 19.9s Stats over 6 runs: max = 19.9s, min = 13.9s, avg = 17.2s, dev = 1.8s //tensorflow/compiler/xla/tests:prng_test_cpu PASSED in 7.4s Stats over 6 runs: max = 7.4s, min = 6.3s, avg = 6.6s, dev = 0.4s //tensorflow/python/kernel_tests/math_ops:reduction_ops_test_cpu PASSED in 32.0s Stats over 6 runs: max = 32.0s, min = 16.6s, avg = 25.0s, dev = 4.6s //tensorflow/compiler/tests:matrix_diag_ops_test_cpu_mlir_bridge_test PASSED in 67.4s Stats over 8 runs: max = 67.4s, min = 3.5s, avg = 25.6s, dev = 22.1s //tensorflow/python/data/experimental/kernel_tests:parallel_interleave_test PASSED in 26.4s Stats over 8 runs: max = 26.4s, min = 9.1s, avg = 17.5s, dev = 5.9s //tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test PASSED in 18.8s Stats over 8 runs: max = 18.8s, min = 11.4s, avg = 14.5s, dev = 2.6s //tensorflow/python/data/kernel_tests:filter_test PASSED in 15.1s Stats over 8 runs: max = 15.1s, min = 11.7s, avg = 13.1s, dev = 1.2s //tensorflow/python/data/kernel_tests:flat_map_test PASSED in 19.5s Stats over 8 runs: max = 19.5s, min = 11.2s, avg = 15.3s, dev = 3.1s //tensorflow/python/distribute/failure_handling:failure_handler_test PASSED in 44.7s Stats over 8 runs: max = 44.7s, min = 12.1s, avg = 32.5s, dev = 10.6s //tensorflow/python/ops/ragged:dynamic_ragged_shape_test PASSED in 42.8s Stats over 8 runs: max = 42.8s, min = 26.7s, avg = 33.2s, dev = 5.3s //tensorflow/compiler/tests:bincount_op_test_cpu PASSED in 5.9s Stats over 10 runs: max = 5.9s, min = 5.3s, avg = 5.4s, dev = 0.2s //tensorflow/compiler/tests:conv2d_test_cpu_mlir_bridge_test PASSED in 5.9s Stats over 10 runs: max = 5.9s, min = 4.5s, avg = 5.5s, dev = 0.4s //tensorflow/compiler/tests:image_ops_test_cpu PASSED in 13.9s Stats over 10 runs: max = 13.9s, min = 8.3s, avg = 11.2s, dev = 2.1s //tensorflow/compiler/tests:random_ops_test_cpu PASSED in 17.7s Stats over 10 runs: max = 17.7s, min = 10.2s, avg = 14.1s, dev = 2.3s //tensorflow/compiler/xla/client/lib:svd_test_cpu PASSED in 64.6s Stats over 10 runs: max = 64.6s, min = 6.6s, avg = 23.0s, dev = 21.7s //tensorflow/compiler/xla/client/lib:tridiagonal_test_cpu PASSED in 6.9s Stats over 10 runs: max = 6.9s, min = 6.1s, avg = 6.6s, dev = 0.2s //tensorflow/python:special_math_ops_test_cpu PASSED in 42.2s Stats over 10 runs: max = 42.2s, min = 5.2s, avg = 11.6s, dev = 10.4s //tensorflow/python/distribute:input_lib_type_spec_test_2gpu PASSED in 15.5s Stats over 10 runs: max = 15.5s, min = 4.1s, avg = 10.0s, dev = 3.8s //tensorflow/python/distribute:input_lib_type_spec_test_cpu PASSED in 15.6s Stats over 10 runs: max = 15.6s, min = 6.2s, avg = 10.8s, dev = 3.3s //tensorflow/python/kernel_tests/array_ops:array_ops_test_cpu PASSED in 11.3s Stats over 10 runs: max = 11.3s, min = 6.5s, avg = 8.6s, dev = 1.4s //tensorflow/python/kernel_tests/linalg:linear_operator_low_rank_update_test_cpu PASSED in 67.5s Stats over 10 runs: max = 67.5s, min = 62.6s, avg = 64.6s, dev = 1.4s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_ops_test_cpu PASSED in 24.5s Stats over 10 runs: max = 24.5s, min = 6.6s, avg = 15.3s, dev = 5.8s //tensorflow/python/kernel_tests/nn_ops:pooling_ops_test_cpu PASSED in 22.9s Stats over 10 runs: max = 22.9s, min = 3.7s, avg = 9.0s, dev = 6.2s //tensorflow/python/kernel_tests/nn_ops:rnn_test_cpu PASSED in 8.7s Stats over 10 runs: max = 8.7s, min = 4.6s, avg = 6.9s, dev = 1.5s //tensorflow/python/kernel_tests/random:random_index_shuffle_test PASSED in 6.6s Stats over 10 runs: max = 6.6s, min = 5.8s, avg = 6.2s, dev = 0.3s //tensorflow/python/ops/ragged:ragged_tensor_supported_values_test PASSED in 16.1s Stats over 10 runs: max = 16.1s, min = 13.1s, avg = 14.2s, dev = 0.9s //tensorflow/python/data/kernel_tests:choose_from_datasets_test PASSED in 12.8s Stats over 12 runs: max = 12.8s, min = 5.1s, avg = 8.8s, dev = 1.8s //tensorflow/python/distribute:multi_process_runner_test_cpu PASSED in 221.4s Stats over 12 runs: max = 221.4s, min = 12.2s, avg = 48.8s, dev = 58.0s //tensorflow/python/eager/polymorphic_function:polymorphic_function_test_cpu PASSED in 14.1s Stats over 15 runs: max = 14.1s, min = 10.2s, avg = 11.5s, dev = 1.4s //tensorflow/python/kernel_tests/nn_ops:rnn_cell_test_cpu PASSED in 45.1s Stats over 15 runs: max = 45.1s, min = 4.6s, avg = 11.2s, dev = 9.7s //tensorflow/python:image_ops_test_cpu PASSED in 12.5s Stats over 16 runs: max = 12.5s, min = 5.7s, avg = 9.3s, dev = 2.0s //tensorflow/python/data/experimental/kernel_tests/service:dynamic_sharding_test PASSED in 19.0s Stats over 16 runs: max = 19.0s, min = 7.8s, avg = 13.1s, dev = 3.2s //tensorflow/python/data/experimental/kernel_tests/service:worker_tags_test PASSED in 18.7s Stats over 16 runs: max = 18.7s, min = 2.9s, avg = 9.8s, dev = 4.5s //tensorflow/python/data/kernel_tests:snapshot_test PASSED in 22.1s Stats over 16 runs: max = 22.1s, min = 9.1s, avg = 14.1s, dev = 3.8s //tensorflow/python/kernel_tests/signal:dct_ops_test_cpu PASSED in 9.2s Stats over 16 runs: max = 9.2s, min = 6.2s, avg = 7.5s, dev = 1.0s //tensorflow/python/ops/parallel_for:control_flow_ops_test_cpu PASSED in 55.5s Stats over 16 runs: max = 55.5s, min = 9.5s, avg = 17.1s, dev = 10.6s //tensorflow/python/data/kernel_tests:map_test PASSED in 33.2s Stats over 19 runs: max = 33.2s, min = 9.9s, avg = 16.1s, dev = 5.4s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 9.1s Stats over 20 runs: max = 9.1s, min = 2.6s, avg = 4.4s, dev = 2.0s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 10.7s Stats over 20 runs: max = 10.7s, min = 2.7s, avg = 4.9s, dev = 1.8s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 10.0s Stats over 20 runs: max = 10.0s, min = 2.8s, avg = 4.5s, dev = 1.9s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 6.8s Stats over 20 runs: max = 6.8s, min = 6.0s, avg = 6.3s, dev = 0.2s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 13.2s Stats over 20 runs: max = 13.2s, min = 9.0s, avg = 11.3s, dev = 1.2s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 11.3s Stats over 20 runs: max = 11.3s, min = 9.5s, avg = 10.2s, dev = 0.5s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 41.4s Stats over 20 runs: max = 41.4s, min = 6.4s, avg = 14.1s, dev = 10.2s //tensorflow/python/kernel_tests:metrics_test PASSED in 37.8s Stats over 20 runs: max = 37.8s, min = 6.3s, avg = 17.4s, dev = 8.8s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 5.2s Stats over 20 runs: max = 5.2s, min = 2.5s, avg = 2.9s, dev = 0.7s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 12.3s Stats over 20 runs: max = 12.3s, min = 2.7s, avg = 5.1s, dev = 2.5s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 38.8s Stats over 20 runs: max = 38.8s, min = 4.0s, avg = 12.8s, dev = 11.2s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 95.0s Stats over 20 runs: max = 95.0s, min = 25.9s, avg = 52.5s, dev = 19.9s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 10.9s Stats over 20 runs: max = 10.9s, min = 4.4s, avg = 7.7s, dev = 2.0s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 16.5s Stats over 20 runs: max = 16.5s, min = 14.6s, avg = 15.3s, dev = 0.6s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 20.2s Stats over 20 runs: max = 20.2s, min = 2.6s, avg = 6.3s, dev = 4.3s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 19.5s Stats over 24 runs: max = 19.5s, min = 3.5s, avg = 9.1s, dev = 4.6s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 7.0s Stats over 25 runs: max = 7.0s, min = 6.1s, avg = 6.3s, dev = 0.2s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 7.7s Stats over 30 runs: max = 7.7s, min = 6.2s, avg = 6.7s, dev = 0.3s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 6.7s Stats over 30 runs: max = 6.7s, min = 5.9s, avg = 6.3s, dev = 0.2s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 29.4s Stats over 30 runs: max = 29.4s, min = 2.7s, avg = 9.8s, dev = 6.4s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 21.3s Stats over 32 runs: max = 21.3s, min = 6.7s, avg = 13.0s, dev = 3.9s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 8.8s Stats over 40 runs: max = 8.8s, min = 7.1s, avg = 8.0s, dev = 0.4s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 11.0s Stats over 40 runs: max = 11.0s, min = 6.7s, avg = 8.3s, dev = 1.1s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 86.7s Stats over 50 runs: max = 86.7s, min = 16.8s, avg = 38.4s, dev = 25.9s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 12.5s Stats over 50 runs: max = 12.5s, min = 3.8s, avg = 7.2s, dev = 2.3s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 5.6s Stats over 50 runs: max = 5.6s, min = 2.5s, avg = 3.7s, dev = 1.0s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 9.8s Stats over 50 runs: max = 9.8s, min = 2.5s, avg = 3.6s, dev = 1.7s Executed 1625 out of 3594 tests: 1624 tests pass, 1170 fail to build, 1 fails locally and 799 were skipped. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages] *** Thursday 16 February 2023 03:41:45 +0000 (0:54:53.207) 1:45:41.251 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) save list of installed Python packages] *** Thursday 16 February 2023 03:41:47 +0000 (0:00:01.848) 1:45:43.099 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) save tests output to file] ******** Thursday 16 February 2023 03:41:48 +0000 (0:00:00.694) 1:45:43.793 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) save tests stderr output to file] *** Thursday 16 February 2023 03:41:48 +0000 (0:00:00.754) 1:45:44.547 ***** An exception occurred during task execution. To see the full traceback, use -vvv. The error was: OSError: [Errno 28] No space left on device fatal: [localhost]: FAILED! => msg: Unexpected failure during module execution. stdout: '' PLAY RECAP ********************************************************************* localhost : ok=35 changed=28 unreachable=0 failed=1 skipped=8 rescued=0 ignored=1 Thursday 16 February 2023 03:41:49 +0000 (0:00:00.174) 1:45:44.722 ***** =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow-oneDNN-ACL git tests 3293.21s tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git 2857.22s tensorflow_in_container : (Python 3.8) build Python package ----------- 116.62s tensorflow_in_container : (Python 3.8) install Python packages --------- 28.44s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 20.24s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.82s tensorflow_in_container : (Python 3.8) start build container ------------ 3.82s tensorflow_in_container : (Python 3.8) collect list of installed Python packages --- 1.85s Gathering Facts --------------------------------------------------------- 1.63s Create cache dirs ------------------------------------------------------- 1.38s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.23s tensorflow : Save git commit hash to file ------------------------------- 1.14s tensorflow_in_container : (Python 3.8) cleanup Bazel install directory --- 0.94s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.85s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.84s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.80s tensorflow_in_container : (Python 3.8) save tests output to file -------- 0.75s tensorflow : Create readme file about unit tests ------------------------ 0.73s tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.72s Build step 'Execute shell' marked build as failure

1 year, 10 months

1
1
0 0

Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #693

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/693/disp…> Changes: ------------------------------------------ [...truncated 1.73 KB...] the implicit localhost does not match 'all' PLAY [Build TensorFlow in Dual ABI container] ********************************** TASK [Gathering Facts] ********************************************************* Thursday 16 February 2023 18:10:30 +0000 (0:00:00.064) 0:00:00.064 ***** ok: [localhost] TASK [Cleanup after previous build] ******************************************** Thursday 16 February 2023 18:10:33 +0000 (0:00:02.673) 0:00:02.738 ***** changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels) ok: [localhost] => (item=tensorflow) TASK [Create cache dirs] ******************************************************* Thursday 16 February 2023 18:10:34 +0000 (0:00:01.286) 0:00:04.025 ***** changed: [localhost] => (item=disk-cache) ok: [localhost] => (item=bazel-cache) changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels) TASK [Set dual abi variable] *************************************************** Thursday 16 February 2023 18:10:36 +0000 (0:00:01.408) 0:00:05.434 ***** ok: [localhost] TASK [Go through each TensorFlow version] ************************************** Thursday 16 February 2023 18:10:36 +0000 (0:00:00.039) 0:00:05.473 ***** skipping: [localhost] => (item={'key': '2.12', 'value': {'tensorflow_version': '2.12.0-rc0', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.12.0rc0', 'tensorboard_version': '==2.12.0', 'tensorflow_estimator_version': '==2.12.0rc0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/core/platform:ram_file_system_test', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/compiler/xla:xla_test_cpu', '//tensorflow/python/data/experimental/kernel_tests:checkpoint_input_pipeline_hook_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/distribute:parameter_server_strategy_test_cpu', '//tensorflow/python/distribute:parameter_server_strategy_test_2gpu', '//tensorflow/python/kernel_tests/linalg:matrix_triangular_solve_op_test', '//tensorflow/python/training:server_lib_test', '//tensorflow/tsl/framework/convolution:spatial_convolutions_test'], 'serial_unit_tests_exclude': ['//tensorflow/python/debug/lib:source_remote_test'], 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-no_oss_py38,-no_oss_py39,-no_oss_py310', 'python_versions': ['cp38-cp38', 'cp39-cp39', 'cp310-cp310', 'cp311-cp311']}}) skipping: [localhost] => (item={'key': '2.11', 'value': {'tensorflow_version': '2.11.0', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.11.0', 'tensorboard_version': '==2.11.2', 'tensorflow_estimator_version': '==2.11.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/training:server_lib_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.10', 'value': {'tensorflow_version': '2.10.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.10.0', 'tensorboard_version': '==2.10.1', 'tensorflow_estimator_version': '==2.10.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tensorflow/tests/...', '//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/tests:jit_test_cpu', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/training:server_lib_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.9', 'value': {'tensorflow_version': '2.9.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.9.0', 'tensorboard_version': '==2.9.0', 'tensorflow_estimator_version': '==2.9.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.8', 'value': {'tensorflow_version': '2.8.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.8.0', 'tensorboard_version': '==2.8.0', 'tensorflow_estimator_version': '==2.8.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/mlir/lite/tests:prepare-tf.mlir.test', '//tensorflow/compiler/mlir/tensorflow:dump_graph_test', '//tensorflow/core/common_runtime:direct_session_test', '//tensorflow/core/common_runtime:direct_session_with_debug_test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:quantize_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python:quantized_ops_test', '//tensorflow/python:script_ops_test', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.7', 'value': {'tensorflow_version': '2.7.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.5', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.7.0', 'tensorboard_version': '==2.7.0', 'tensorflow_estimator_version': '==2.7.0', 'python_install_packages': ['portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/java/...', '//tensorflow/lite/...', '//tensorflow/compiler/xla/python/...', '//tensorflow/compiler/xla/service/cpu/...', '//tensorflow/compiler/xla/tests/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/core/kernels:sparse_matmul_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/debug/cli:debugger_cli_common_test', '//tensorflow/python/debug/examples/v2:examples_v2_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/keras/mixed_precision:model_test', '//tensorflow/python/keras/preprocessing:image_test', '//tensorflow/python/kernel_tests:init_ops_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests:self_adjoint_eig_op_test', '//tensorflow/python/kernel_tests:sparse_matmul_op_test', '//tensorflow/python/lib/io:file_io_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python/ops/ragged:ragged_print_op_test', '//tensorflow/python/profiler/integration_test:profiler_api_test', '//tensorflow/python/profiler:profiler_v2_test', '//tensorflow/python/util:dispatch_test', '//tensorflow/python/util:traceback_utils_test', '//tensorflow/tools/api/tests:api_compatibility_test', '//tensorflow/tools/docs:tf_doctest', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.6', 'value': {'tensorflow_version': '2.6.5', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.6.0', 'tensorboard_version': '==2.6.0', 'tensorflow_estimator_version': '==2.6.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.5', 'value': {'tensorflow_version': '2.5.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.34.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.5.0', 'tensorboard_version': '==2.5.0', 'tensorflow_estimator_version': '==2.5.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.4', 'value': {'tensorflow_version': '2.4.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.3.3', 'grpcio_version': '~=1.32.0', 'h5py_version': '~=2.10', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.4.3', 'tensorboard_version': '==2.4.1', 'tensorflow_estimator_version': '==2.4.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '1.15', 'value': {'tensorflow_version': '1.15.5', 'bazel_version': '0.29.1', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.2.2', 'grpcio_version': '~=1.32.0', 'h5py_version': '==2.10', 'numpy_version': '~=1.18.0', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==1.2.2', 'tensorboard_version': '==1.15.0', 'tensorflow_estimator_version': '==1.15.2', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m']}}) TASK [tensorflow : Set TensorFlow and other package versions] ****************** Thursday 16 February 2023 18:10:36 +0000 (0:00:00.261) 0:00:05.734 ***** ok: [localhost] TASK [tensorflow : Set build dir for TensorFlow git] *************************** Thursday 16 February 2023 18:10:36 +0000 (0:00:00.085) 0:00:05.819 ***** ok: [localhost] TASK [tensorflow : Remove TensorFlow git sources from previous build] ********** Thursday 16 February 2023 18:10:36 +0000 (0:00:00.047) 0:00:05.867 ***** changed: [localhost] TASK [tensorflow : Fetch TensorFlow] ******************************************* Thursday 16 February 2023 18:10:40 +0000 (0:00:03.570) 0:00:09.437 ***** included: <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/confi…> for localhost TASK [tensorflow : Fetch TensorFlow git source] ******************************** Thursday 16 February 2023 18:10:40 +0000 (0:00:00.118) 0:00:09.555 ***** skipping: [localhost] TASK [tensorflow : Unpack TensorFlow git source] ******************************* Thursday 16 February 2023 18:10:40 +0000 (0:00:00.041) 0:00:09.597 ***** skipping: [localhost] TASK [tensorflow : Rename source dir for oneDNN build] ************************* Thursday 16 February 2023 18:10:40 +0000 (0:00:00.038) 0:00:09.636 ***** skipping: [localhost] TASK [tensorflow : Fetch TensorFlow from git] ********************************** Thursday 16 February 2023 18:10:40 +0000 (0:00:00.041) 0:00:09.678 ***** changed: [localhost] TASK [tensorflow : Fetch TensorFlow from git at commit] ************************ Thursday 16 February 2023 18:11:03 +0000 (0:00:22.762) 0:00:32.440 ***** skipping: [localhost] TASK [tensorflow : Set world write access to source] *************************** Thursday 16 February 2023 18:11:03 +0000 (0:00:00.037) 0:00:32.477 ***** changed: [localhost] TASK [tensorflow : Get oneline version of git log for this checkout] *********** Thursday 16 February 2023 18:11:03 +0000 (0:00:00.374) 0:00:32.852 ***** changed: [localhost] TASK [tensorflow : Show git log] *********************************************** Thursday 16 February 2023 18:11:04 +0000 (0:00:00.583) 0:00:33.435 ***** ok: [localhost] => git_log.stdout: '49acb93169c0dfb493895da41f3587d8486bfd2a Merge pull request #59536 from ROCmSoftwarePlatform:fix_tensor_or_memref_build' TASK [tensorflow : Record git commit hash to variable] ************************* Thursday 16 February 2023 18:11:04 +0000 (0:00:00.045) 0:00:33.481 ***** ok: [localhost] TASK [tensorflow : Save git commit hash to file] ******************************* Thursday 16 February 2023 18:11:04 +0000 (0:00:00.086) 0:00:33.567 ***** changed: [localhost] TASK [Build Bazel] ************************************************************* Thursday 16 February 2023 18:11:05 +0000 (0:00:01.116) 0:00:34.684 ***** skipping: [localhost] TASK [Build TensorFlow for each Python version] ******************************** Thursday 16 February 2023 18:11:05 +0000 (0:00:00.037) 0:00:34.721 ***** skipping: [localhost] => (item=3.8) skipping: [localhost] => (item=3.9) skipping: [localhost] => (item=3.10) skipping: [localhost] => (item=3.11) TASK [Build TensorFlow for each Python version (dual abi)] ********************* Thursday 16 February 2023 18:11:05 +0000 (0:00:00.056) 0:00:34.778 ***** TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Thursday 16 February 2023 18:11:06 +0000 (0:00:00.633) 0:00:35.412 ***** changed: [localhost] TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] *** Thursday 16 February 2023 18:11:06 +0000 (0:00:00.634) 0:00:36.047 ***** skipping: [localhost] TASK [Fetch TensorFlow] ******************************************************** Thursday 16 February 2023 18:11:06 +0000 (0:00:00.038) 0:00:36.085 ***** skipping: [localhost] TASK [(Python 3.8) patch TensorFlow tree] ************************************** Thursday 16 February 2023 18:11:06 +0000 (0:00:00.038) 0:00:36.124 ***** TASK [tensorflow : Create linklibs shell script] ******************************* Thursday 16 February 2023 18:11:07 +0000 (0:00:00.152) 0:00:36.277 ***** changed: [localhost] TASK [tensorflow : Create readme file about unit tests] ************************ Thursday 16 February 2023 18:11:07 +0000 (0:00:00.700) 0:00:36.978 ***** changed: [localhost] TASK [tensorflow : Add to the copied files] ************************************ Thursday 16 February 2023 18:11:08 +0000 (0:00:00.703) 0:00:37.681 ***** changed: [localhost] TASK [tensorflow : Add to the long_description in setup.py] ******************** Thursday 16 February 2023 18:11:09 +0000 (0:00:00.561) 0:00:38.242 ***** changed: [localhost] TASK [tensorflow : Use nightly package requirements] *************************** Thursday 16 February 2023 18:11:09 +0000 (0:00:00.551) 0:00:38.794 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) start build container] ************ Thursday 16 February 2023 18:11:10 +0000 (0:00:00.392) 0:00:39.186 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir] *** Thursday 16 February 2023 18:11:11 +0000 (0:00:01.963) 0:00:41.149 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for bazel cache] ****** Thursday 16 February 2023 18:11:13 +0000 (0:00:01.187) 0:00:42.337 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for bazelisk cache] *** Thursday 16 February 2023 18:11:13 +0000 (0:00:00.811) 0:00:43.148 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for pip cache] ******** Thursday 16 February 2023 18:11:14 +0000 (0:00:00.835) 0:00:43.983 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) copy upper constraints] *********** Thursday 16 February 2023 18:11:15 +0000 (0:00:00.817) 0:00:44.801 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) install Python packages] ********** Thursday 16 February 2023 18:11:16 +0000 (0:00:00.719) 0:00:45.520 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) build TensorFlow git] ************* Thursday 16 February 2023 18:11:44 +0000 (0:00:28.110) 0:01:13.631 ***** fatal: [localhost]: FAILED! => changed=true rc: 37 stderr: |- Extracting Bazel installation... Starting local Bazel server and connecting to it... INFO: Invocation ID: eb3cb519-741f-4160-9138-1e93b3573923 INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Reading rc options for 'build' from /usertools/aarch64.bazelrc: 'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/bin/python3 --action_env PYTHON_LIB_PATH=/usr/lib/tf_python --python_path=/usr/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --distinct_host_configuration=false --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3 INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64.bazelrc: --disk_cache=/tf/cache INFO: Found applicable config definition build:ambe in file /usertools/aarch64.bazelrc: --distinct_host_configuration=false --flaky_test_attempts=3 --action_env=PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin --host_crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --extra_toolchains=@ml2014_aarch64_config_aarch64//crosstool:toolchain-linux-aarch64 --extra_execution_platforms=@ml2014_aarch64_config_aarch64_platform//:platform --host_platform=@ml2014_aarch64_config_aarch64_platform//:platform --platforms=@ml2014_aarch64_config_aarch64_platform//:platform --repo_env=TF_PYTHON_CONFIG_REPO=@ml2014_aarch64_config_python INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/tensorflow/… failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-p… failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured) WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/curl.haxx.se/download/… failed: class java.io.FileNotFoundException GET returned 404 Not Found Analyzing: target //tensorflow/tools/pip_package:build_pip_package (290 packages loaded, 4305 targets configured) Server terminated abruptly (error code: 14, error message: 'Socket closed', log file: '/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/server/jvm.out') stderr_lines: <omitted> stdout: '' stdout_lines: <omitted> PLAY RECAP ********************************************************************* localhost : ok=27 changed=20 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0 Thursday 16 February 2023 18:13:01 +0000 (0:01:16.727) 0:02:30.358 ***** =============================================================================== tensorflow_in_container : (Python 3.8) build TensorFlow git ------------ 76.73s tensorflow_in_container : (Python 3.8) install Python packages --------- 28.11s tensorflow : Fetch TensorFlow from git --------------------------------- 22.76s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.57s Gathering Facts --------------------------------------------------------- 2.67s tensorflow_in_container : (Python 3.8) start build container ------------ 1.96s Create cache dirs ------------------------------------------------------- 1.41s Cleanup after previous build -------------------------------------------- 1.29s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.19s tensorflow : Save git commit hash to file ------------------------------- 1.12s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.84s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.82s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.81s tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.72s tensorflow : Create readme file about unit tests ------------------------ 0.70s tensorflow : Create linklibs shell script ------------------------------- 0.70s tensorflow_in_container : Reset checkout to clean state ----------------- 0.63s Build TensorFlow for each Python version (dual abi) --------------------- 0.63s tensorflow : Get oneline version of git log for this checkout ----------- 0.58s tensorflow : Add to the copied files ------------------------------------ 0.56s Build step 'Execute shell' marked build as failure

1 year, 10 months

1
1
0 0

Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #691

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/691/disp…> Changes: ------------------------------------------ [...truncated 1.54 KB...] + sed -i -es+/tmp/workspace+<https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/+g> vars/vars.yml + ansible-playbook playbooks/build-tf-dual-abi.yml [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' PLAY [Build TensorFlow in Dual ABI container] ********************************** TASK [Gathering Facts] ********************************************************* Wednesday 15 February 2023 18:10:04 +0000 (0:00:00.064) 0:00:00.064 **** ok: [localhost] TASK [Cleanup after previous build] ******************************************** Wednesday 15 February 2023 18:10:07 +0000 (0:00:02.684) 0:00:02.749 **** changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels) ok: [localhost] => (item=tensorflow) TASK [Create cache dirs] ******************************************************* Wednesday 15 February 2023 18:10:08 +0000 (0:00:01.279) 0:00:04.029 **** ok: [localhost] => (item=disk-cache) ok: [localhost] => (item=bazel-cache) changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels) TASK [Set dual abi variable] *************************************************** Wednesday 15 February 2023 18:10:09 +0000 (0:00:01.384) 0:00:05.414 **** ok: [localhost] TASK [Go through each TensorFlow version] ************************************** Wednesday 15 February 2023 18:10:10 +0000 (0:00:00.059) 0:00:05.473 **** skipping: [localhost] => (item={'key': '2.12', 'value': {'tensorflow_version': '2.12.0-rc0', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.12.0rc0', 'tensorboard_version': '==2.12.0', 'tensorflow_estimator_version': '==2.12.0rc0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/core/platform:ram_file_system_test', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/compiler/xla:xla_test_cpu', '//tensorflow/python/data/experimental/kernel_tests:checkpoint_input_pipeline_hook_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/distribute:parameter_server_strategy_test_cpu', '//tensorflow/python/distribute:parameter_server_strategy_test_2gpu', '//tensorflow/python/kernel_tests/linalg:matrix_triangular_solve_op_test', '//tensorflow/python/training:server_lib_test', '//tensorflow/tsl/framework/convolution:spatial_convolutions_test'], 'serial_unit_tests_exclude': ['//tensorflow/python/debug/lib:source_remote_test'], 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-no_oss_py38,-no_oss_py39,-no_oss_py310', 'python_versions': ['cp38-cp38', 'cp39-cp39', 'cp310-cp310', 'cp311-cp311']}}) skipping: [localhost] => (item={'key': '2.11', 'value': {'tensorflow_version': '2.11.0', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.11.0', 'tensorboard_version': '==2.11.2', 'tensorflow_estimator_version': '==2.11.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/training:server_lib_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.10', 'value': {'tensorflow_version': '2.10.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.10.0', 'tensorboard_version': '==2.10.1', 'tensorflow_estimator_version': '==2.10.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tensorflow/tests/...', '//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/tests:jit_test_cpu', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/training:server_lib_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.9', 'value': {'tensorflow_version': '2.9.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.9.0', 'tensorboard_version': '==2.9.0', 'tensorflow_estimator_version': '==2.9.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.8', 'value': {'tensorflow_version': '2.8.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.8.0', 'tensorboard_version': '==2.8.0', 'tensorflow_estimator_version': '==2.8.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/mlir/lite/tests:prepare-tf.mlir.test', '//tensorflow/compiler/mlir/tensorflow:dump_graph_test', '//tensorflow/core/common_runtime:direct_session_test', '//tensorflow/core/common_runtime:direct_session_with_debug_test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:quantize_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python:quantized_ops_test', '//tensorflow/python:script_ops_test', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.7', 'value': {'tensorflow_version': '2.7.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.5', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.7.0', 'tensorboard_version': '==2.7.0', 'tensorflow_estimator_version': '==2.7.0', 'python_install_packages': ['portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/java/...', '//tensorflow/lite/...', '//tensorflow/compiler/xla/python/...', '//tensorflow/compiler/xla/service/cpu/...', '//tensorflow/compiler/xla/tests/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/core/kernels:sparse_matmul_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/debug/cli:debugger_cli_common_test', '//tensorflow/python/debug/examples/v2:examples_v2_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/keras/mixed_precision:model_test', '//tensorflow/python/keras/preprocessing:image_test', '//tensorflow/python/kernel_tests:init_ops_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests:self_adjoint_eig_op_test', '//tensorflow/python/kernel_tests:sparse_matmul_op_test', '//tensorflow/python/lib/io:file_io_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python/ops/ragged:ragged_print_op_test', '//tensorflow/python/profiler/integration_test:profiler_api_test', '//tensorflow/python/profiler:profiler_v2_test', '//tensorflow/python/util:dispatch_test', '//tensorflow/python/util:traceback_utils_test', '//tensorflow/tools/api/tests:api_compatibility_test', '//tensorflow/tools/docs:tf_doctest', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.6', 'value': {'tensorflow_version': '2.6.5', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.6.0', 'tensorboard_version': '==2.6.0', 'tensorflow_estimator_version': '==2.6.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.5', 'value': {'tensorflow_version': '2.5.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.34.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.5.0', 'tensorboard_version': '==2.5.0', 'tensorflow_estimator_version': '==2.5.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.4', 'value': {'tensorflow_version': '2.4.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.3.3', 'grpcio_version': '~=1.32.0', 'h5py_version': '~=2.10', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.4.3', 'tensorboard_version': '==2.4.1', 'tensorflow_estimator_version': '==2.4.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '1.15', 'value': {'tensorflow_version': '1.15.5', 'bazel_version': '0.29.1', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.2.2', 'grpcio_version': '~=1.32.0', 'h5py_version': '==2.10', 'numpy_version': '~=1.18.0', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==1.2.2', 'tensorboard_version': '==1.15.0', 'tensorflow_estimator_version': '==1.15.2', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m']}}) TASK [tensorflow : Set TensorFlow and other package versions] ****************** Wednesday 15 February 2023 18:10:10 +0000 (0:00:00.258) 0:00:05.732 **** ok: [localhost] TASK [tensorflow : Set build dir for TensorFlow git] *************************** Wednesday 15 February 2023 18:10:10 +0000 (0:00:00.083) 0:00:05.816 **** ok: [localhost] TASK [tensorflow : Remove TensorFlow git sources from previous build] ********** Wednesday 15 February 2023 18:10:10 +0000 (0:00:00.047) 0:00:05.863 **** changed: [localhost] TASK [tensorflow : Fetch TensorFlow] ******************************************* Wednesday 15 February 2023 18:10:14 +0000 (0:00:03.814) 0:00:09.677 **** included: <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/confi…> for localhost TASK [tensorflow : Fetch TensorFlow git source] ******************************** Wednesday 15 February 2023 18:10:14 +0000 (0:00:00.117) 0:00:09.795 **** skipping: [localhost] TASK [tensorflow : Unpack TensorFlow git source] ******************************* Wednesday 15 February 2023 18:10:14 +0000 (0:00:00.040) 0:00:09.835 **** skipping: [localhost] TASK [tensorflow : Rename source dir for oneDNN build] ************************* Wednesday 15 February 2023 18:10:14 +0000 (0:00:00.039) 0:00:09.875 **** skipping: [localhost] TASK [tensorflow : Fetch TensorFlow from git] ********************************** Wednesday 15 February 2023 18:10:14 +0000 (0:00:00.040) 0:00:09.915 **** changed: [localhost] TASK [tensorflow : Fetch TensorFlow from git at commit] ************************ Wednesday 15 February 2023 18:10:43 +0000 (0:00:29.139) 0:00:39.054 **** skipping: [localhost] TASK [tensorflow : Set world write access to source] *************************** Wednesday 15 February 2023 18:10:43 +0000 (0:00:00.038) 0:00:39.093 **** changed: [localhost] TASK [tensorflow : Get oneline version of git log for this checkout] *********** Wednesday 15 February 2023 18:10:44 +0000 (0:00:00.372) 0:00:39.466 **** changed: [localhost] TASK [tensorflow : Show git log] *********************************************** Wednesday 15 February 2023 18:10:44 +0000 (0:00:00.583) 0:00:40.049 **** ok: [localhost] => git_log.stdout: 74a401f8c7128487786cd115882d96fbf9cf08fe Update TFRT dependency to use revision http://github.com/tensorflow/runtime/commit/2e0c1263c4bd2f6f3facc74bb9f6c12…. TASK [tensorflow : Record git commit hash to variable] ************************* Wednesday 15 February 2023 18:10:44 +0000 (0:00:00.044) 0:00:40.094 **** ok: [localhost] TASK [tensorflow : Save git commit hash to file] ******************************* Wednesday 15 February 2023 18:10:44 +0000 (0:00:00.086) 0:00:40.180 **** changed: [localhost] TASK [Build Bazel] ************************************************************* Wednesday 15 February 2023 18:10:45 +0000 (0:00:01.111) 0:00:41.292 **** skipping: [localhost] TASK [Build TensorFlow for each Python version] ******************************** Wednesday 15 February 2023 18:10:45 +0000 (0:00:00.037) 0:00:41.330 **** skipping: [localhost] => (item=3.8) skipping: [localhost] => (item=3.9) skipping: [localhost] => (item=3.10) skipping: [localhost] => (item=3.11) TASK [Build TensorFlow for each Python version (dual abi)] ********************* Wednesday 15 February 2023 18:10:45 +0000 (0:00:00.056) 0:00:41.386 **** TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Wednesday 15 February 2023 18:10:46 +0000 (0:00:00.631) 0:00:42.018 **** changed: [localhost] TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] *** Wednesday 15 February 2023 18:10:47 +0000 (0:00:00.633) 0:00:42.652 **** skipping: [localhost] TASK [Fetch TensorFlow] ******************************************************** Wednesday 15 February 2023 18:10:47 +0000 (0:00:00.036) 0:00:42.689 **** skipping: [localhost] TASK [(Python 3.8) patch TensorFlow tree] ************************************** Wednesday 15 February 2023 18:10:47 +0000 (0:00:00.039) 0:00:42.728 **** TASK [tensorflow : Create linklibs shell script] ******************************* Wednesday 15 February 2023 18:10:47 +0000 (0:00:00.150) 0:00:42.879 **** changed: [localhost] TASK [tensorflow : Create readme file about unit tests] ************************ Wednesday 15 February 2023 18:10:48 +0000 (0:00:00.696) 0:00:43.575 **** changed: [localhost] TASK [tensorflow : Add to the copied files] ************************************ Wednesday 15 February 2023 18:10:48 +0000 (0:00:00.725) 0:00:44.300 **** changed: [localhost] TASK [tensorflow : Add to the long_description in setup.py] ******************** Wednesday 15 February 2023 18:10:49 +0000 (0:00:00.559) 0:00:44.860 **** changed: [localhost] TASK [tensorflow : Use nightly package requirements] *************************** Wednesday 15 February 2023 18:10:49 +0000 (0:00:00.552) 0:00:45.413 **** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) start build container] ************ Wednesday 15 February 2023 18:10:50 +0000 (0:00:00.390) 0:00:45.804 **** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir] *** Wednesday 15 February 2023 18:10:54 +0000 (0:00:03.805) 0:00:49.609 **** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for bazel cache] ****** Wednesday 15 February 2023 18:10:55 +0000 (0:00:01.162) 0:00:50.771 **** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for bazelisk cache] *** Wednesday 15 February 2023 18:10:56 +0000 (0:00:00.828) 0:00:51.599 **** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for pip cache] ******** Wednesday 15 February 2023 18:10:57 +0000 (0:00:00.849) 0:00:52.449 **** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) copy upper constraints] *********** Wednesday 15 February 2023 18:10:57 +0000 (0:00:00.841) 0:00:53.290 **** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) install Python packages] ********** Wednesday 15 February 2023 18:10:58 +0000 (0:00:00.718) 0:00:54.009 **** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) build TensorFlow git] ************* Wednesday 15 February 2023 18:11:26 +0000 (0:00:28.396) 0:01:22.405 **** fatal: [localhost]: FAILED! => changed=true rc: 37 stderr: |- Extracting Bazel installation... Starting local Bazel server and connecting to it... INFO: Invocation ID: a093c311-45cf-4620-99a1-0ae4f463a888 INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Reading rc options for 'build' from /usertools/aarch64.bazelrc: 'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/bin/python3 --action_env PYTHON_LIB_PATH=/usr/lib/tf_python --python_path=/usr/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --distinct_host_configuration=false --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3 INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64.bazelrc: --disk_cache=/tf/cache INFO: Found applicable config definition build:ambe in file /usertools/aarch64.bazelrc: --distinct_host_configuration=false --flaky_test_attempts=3 --action_env=PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin --host_crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --extra_toolchains=@ml2014_aarch64_config_aarch64//crosstool:toolchain-linux-aarch64 --extra_execution_platforms=@ml2014_aarch64_config_aarch64_platform//:platform --host_platform=@ml2014_aarch64_config_aarch64_platform//:platform --platforms=@ml2014_aarch64_config_aarch64_platform//:platform --repo_env=TF_PYTHON_CONFIG_REPO=@ml2014_aarch64_config_python INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/tensorflow/… failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-p… failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured) WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/openxla/sta… failed: class java.io.FileNotFoundException GET returned 404 Not Found Server terminated abruptly (error code: 14, error message: 'Socket closed', log file: '/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/server/jvm.out') stderr_lines: <omitted> stdout: '' stdout_lines: <omitted> PLAY RECAP ********************************************************************* localhost : ok=27 changed=20 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0 Wednesday 15 February 2023 18:12:49 +0000 (0:01:22.535) 0:02:44.941 **** =============================================================================== tensorflow_in_container : (Python 3.8) build TensorFlow git ------------ 82.54s tensorflow : Fetch TensorFlow from git --------------------------------- 29.14s tensorflow_in_container : (Python 3.8) install Python packages --------- 28.40s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.81s tensorflow_in_container : (Python 3.8) start build container ------------ 3.81s Gathering Facts --------------------------------------------------------- 2.68s Create cache dirs ------------------------------------------------------- 1.38s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.16s tensorflow : Save git commit hash to file ------------------------------- 1.11s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.85s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.84s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.83s tensorflow : Create readme file about unit tests ------------------------ 0.73s tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.72s tensorflow : Create linklibs shell script ------------------------------- 0.70s tensorflow_in_container : Reset checkout to clean state ----------------- 0.63s Build TensorFlow for each Python version (dual abi) --------------------- 0.63s tensorflow : Get oneline version of git log for this checkout ----------- 0.58s tensorflow : Add to the copied files ------------------------------------ 0.56s Build step 'Execute shell' marked build as failure

1 year, 10 months

1
1
0 0

Build failed in Jenkins: Tensorflow oneDNN Python package (manylinux2014 nightly) #327

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/3…> Changes: ------------------------------------------ [...truncated 9.93 MB...] //tensorflow/python/kernel_tests/linalg:linalg_ops_test_cpu PASSED in 49.1s Stats over 8 runs: max = 49.1s, min = 28.3s, avg = 38.7s, dev = 7.8s //tensorflow/python/kernel_tests/linalg:linear_operator_block_lower_triangular_test_cpu PASSED in 50.2s Stats over 8 runs: max = 50.2s, min = 33.0s, avg = 41.2s, dev = 6.0s //tensorflow/python/kernel_tests/nn_ops:depthwise_conv_op_d9m_test_cpu PASSED in 54.9s Stats over 8 runs: max = 54.9s, min = 4.7s, avg = 13.5s, dev = 16.6s //tensorflow/python/kernel_tests/nn_ops:depthwise_conv_op_test_cpu PASSED in 5.4s Stats over 8 runs: max = 5.4s, min = 3.3s, avg = 4.4s, dev = 0.7s //tensorflow/python/kernel_tests/signal:fft_ops_test_cpu PASSED in 14.1s Stats over 8 runs: max = 14.1s, min = 4.8s, avg = 9.1s, dev = 3.7s //tensorflow/python/ops/ragged:dynamic_ragged_shape_test PASSED in 43.3s Stats over 8 runs: max = 43.3s, min = 27.5s, avg = 33.9s, dev = 5.2s //tensorflow/python/ops/ragged:ragged_tensor_test PASSED in 26.7s Stats over 8 runs: max = 26.7s, min = 12.7s, avg = 17.5s, dev = 4.0s //tensorflow/compiler/tests:conv2d_test_cpu PASSED in 6.0s Stats over 10 runs: max = 6.0s, min = 4.2s, avg = 5.4s, dev = 0.5s //tensorflow/compiler/tests:conv2d_test_cpu_mlir_bridge_test PASSED in 6.5s Stats over 10 runs: max = 6.5s, min = 3.5s, avg = 4.5s, dev = 1.0s //tensorflow/compiler/tests:random_ops_test_cpu PASSED in 17.0s Stats over 10 runs: max = 17.0s, min = 10.6s, avg = 13.6s, dev = 2.1s //tensorflow/compiler/tests:random_ops_test_cpu_mlir_bridge_test PASSED in 15.5s Stats over 10 runs: max = 15.5s, min = 7.0s, avg = 9.5s, dev = 2.4s //tensorflow/compiler/tests:stateless_random_ops_test_cpu PASSED in 66.2s Stats over 10 runs: max = 66.2s, min = 30.6s, avg = 49.1s, dev = 12.2s //tensorflow/compiler/tests:stateless_random_ops_test_cpu_mlir_bridge_test PASSED in 79.5s Stats over 10 runs: max = 79.5s, min = 40.7s, avg = 58.2s, dev = 12.6s //tensorflow/compiler/xla/client/lib:svd_test_cpu PASSED in 67.5s Stats over 10 runs: max = 67.5s, min = 7.1s, avg = 24.3s, dev = 22.8s //tensorflow/compiler/xla/client/lib:tridiagonal_test_cpu PASSED in 7.2s Stats over 10 runs: max = 7.2s, min = 6.2s, avg = 6.7s, dev = 0.3s //tensorflow/compiler/xla/service/cpu:cpu_runtime_test PASSED in 2.9s Stats over 10 runs: max = 2.9s, min = 0.9s, avg = 2.3s, dev = 0.7s //tensorflow/python:special_math_ops_test_cpu PASSED in 42.6s Stats over 10 runs: max = 42.6s, min = 6.9s, avg = 12.8s, dev = 10.3s //tensorflow/python/data/kernel_tests:rejection_resample_test PASSED in 13.1s Stats over 10 runs: max = 13.1s, min = 3.9s, avg = 8.3s, dev = 2.5s //tensorflow/python/distribute:input_lib_test_2gpu PASSED in 25.6s Stats over 10 runs: max = 25.6s, min = 17.0s, avg = 21.5s, dev = 2.6s //tensorflow/python/distribute:input_lib_test_cpu PASSED in 28.0s Stats over 10 runs: max = 28.0s, min = 17.2s, avg = 21.6s, dev = 3.2s //tensorflow/python/distribute:input_lib_type_spec_test_2gpu PASSED in 14.4s Stats over 10 runs: max = 14.4s, min = 6.1s, avg = 10.0s, dev = 2.8s //tensorflow/python/distribute:input_lib_type_spec_test_cpu PASSED in 14.4s Stats over 10 runs: max = 14.4s, min = 4.1s, avg = 9.3s, dev = 3.6s //tensorflow/python/framework:config_vgpu_test_2gpu PASSED in 6.2s Stats over 10 runs: max = 6.2s, min = 4.9s, avg = 5.5s, dev = 0.5s //tensorflow/python/framework:config_vgpu_test_cpu PASSED in 7.6s Stats over 10 runs: max = 7.6s, min = 5.1s, avg = 6.2s, dev = 0.8s //tensorflow/python/framework:function_test_cpu PASSED in 57.5s Stats over 10 runs: max = 57.5s, min = 3.5s, avg = 12.1s, dev = 15.4s //tensorflow/python/grappler:cluster_test_cpu PASSED in 6.5s Stats over 10 runs: max = 6.5s, min = 3.6s, avg = 5.1s, dev = 0.9s //tensorflow/python/kernel_tests/array_ops:array_ops_test_cpu PASSED in 9.8s Stats over 10 runs: max = 9.8s, min = 6.3s, avg = 8.2s, dev = 1.2s //tensorflow/python/kernel_tests/array_ops:inplace_ops_test_cpu PASSED in 6.3s Stats over 10 runs: max = 6.3s, min = 4.3s, avg = 5.3s, dev = 0.8s //tensorflow/python/kernel_tests/data_structures:tensor_array_ops_test_cpu PASSED in 9.3s Stats over 10 runs: max = 9.3s, min = 5.5s, avg = 7.3s, dev = 1.4s //tensorflow/python/kernel_tests/linalg:linear_operator_kronecker_test_cpu PASSED in 31.3s Stats over 10 runs: max = 31.3s, min = 27.5s, avg = 29.1s, dev = 1.2s //tensorflow/python/kernel_tests/linalg:linear_operator_low_rank_update_test_cpu PASSED in 78.0s Stats over 10 runs: max = 78.0s, min = 70.9s, avg = 73.5s, dev = 2.1s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_ops_test_cpu PASSED in 31.7s Stats over 10 runs: max = 31.7s, min = 7.1s, avg = 17.3s, dev = 7.7s //tensorflow/python/kernel_tests/math_ops:segment_reduction_ops_test_cpu PASSED in 25.7s Stats over 10 runs: max = 25.7s, min = 6.6s, avg = 13.7s, dev = 7.1s //tensorflow/python/kernel_tests/nn_ops:pooling_ops_test_cpu PASSED in 24.4s Stats over 10 runs: max = 24.4s, min = 4.7s, avg = 9.5s, dev = 6.8s //tensorflow/python/kernel_tests/nn_ops:rnn_test_cpu PASSED in 9.5s Stats over 10 runs: max = 9.5s, min = 6.7s, avg = 8.1s, dev = 1.0s //tensorflow/python/kernel_tests/random:random_index_shuffle_test PASSED in 6.7s Stats over 10 runs: max = 6.7s, min = 5.3s, avg = 6.1s, dev = 0.4s //tensorflow/python/kernel_tests/random:stateless_random_ops_test_cpu PASSED in 95.3s Stats over 10 runs: max = 95.3s, min = 16.2s, avg = 54.8s, dev = 37.7s //tensorflow/python/ops/ragged:ragged_tensor_supported_values_test PASSED in 20.2s Stats over 10 runs: max = 20.2s, min = 16.6s, avg = 18.3s, dev = 1.0s //tensorflow/python/saved_model:load_test_cpu PASSED in 67.9s Stats over 10 runs: max = 67.9s, min = 25.5s, avg = 33.7s, dev = 11.8s //tensorflow/compiler/tests:fft_test_cpu PASSED in 18.6s Stats over 12 runs: max = 18.6s, min = 4.5s, avg = 11.8s, dev = 5.0s //tensorflow/compiler/xla/service:triangular_solve_expander_test PASSED in 6.8s Stats over 12 runs: max = 6.8s, min = 3.3s, avg = 4.8s, dev = 1.1s //tensorflow/python/data/experimental/kernel_tests:group_by_reducer_test PASSED in 14.0s Stats over 12 runs: max = 14.0s, min = 2.8s, avg = 8.6s, dev = 3.6s //tensorflow/python/data/kernel_tests:choose_from_datasets_test PASSED in 13.3s Stats over 12 runs: max = 13.3s, min = 6.1s, avg = 8.5s, dev = 2.0s //tensorflow/python/data/kernel_tests:memory_cleanup_test_cpu PASSED in 8.2s Stats over 12 runs: max = 8.2s, min = 2.8s, avg = 5.6s, dev = 1.4s //tensorflow/python/distribute:multi_process_runner_test_2gpu PASSED in 223.9s Stats over 12 runs: max = 223.9s, min = 12.1s, avg = 47.8s, dev = 58.6s //tensorflow/python/distribute:multi_process_runner_test_cpu PASSED in 225.8s Stats over 12 runs: max = 225.8s, min = 14.9s, avg = 52.0s, dev = 58.2s //tensorflow/python/eager/polymorphic_function:polymorphic_function_test_cpu PASSED in 17.1s Stats over 15 runs: max = 17.1s, min = 11.1s, avg = 13.6s, dev = 1.7s //tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test_cpu PASSED in 66.1s Stats over 15 runs: max = 66.1s, min = 57.8s, avg = 61.4s, dev = 2.5s //tensorflow/python/kernel_tests/nn_ops:rnn_cell_test_cpu PASSED in 53.6s Stats over 15 runs: max = 53.6s, min = 8.5s, avg = 14.3s, dev = 11.1s //tensorflow/python:image_ops_test_cpu PASSED in 17.7s Stats over 16 runs: max = 17.7s, min = 5.7s, avg = 11.4s, dev = 3.1s //tensorflow/python/data/experimental/kernel_tests/service:dynamic_sharding_test PASSED in 21.4s Stats over 16 runs: max = 21.4s, min = 9.2s, avg = 14.3s, dev = 3.2s //tensorflow/python/data/experimental/kernel_tests/service:worker_tags_test PASSED in 28.0s Stats over 16 runs: max = 28.0s, min = 7.5s, avg = 13.3s, dev = 5.0s //tensorflow/python/data/kernel_tests:snapshot_test PASSED in 24.1s Stats over 16 runs: max = 24.1s, min = 10.1s, avg = 16.8s, dev = 3.9s //tensorflow/python/kernel_tests/control_flow:control_flow_ops_py_test_cpu PASSED in 23.6s Stats over 16 runs: max = 23.6s, min = 4.7s, avg = 7.8s, dev = 4.3s //tensorflow/python/kernel_tests/linalg:matrix_exponential_op_test PASSED in 7.2s Stats over 16 runs: max = 7.2s, min = 3.4s, avg = 5.2s, dev = 1.2s //tensorflow/python/kernel_tests/signal:dct_ops_test_cpu PASSED in 11.7s Stats over 16 runs: max = 11.7s, min = 6.4s, avg = 9.1s, dev = 1.7s //tensorflow/python/ops/parallel_for:control_flow_ops_test_cpu PASSED in 53.7s Stats over 16 runs: max = 53.7s, min = 9.7s, avg = 16.7s, dev = 10.2s //tensorflow/python/data/kernel_tests:map_test PASSED in 23.6s Stats over 19 runs: max = 23.6s, min = 9.9s, avg = 16.1s, dev = 4.2s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 6.1s Stats over 20 runs: max = 6.1s, min = 2.8s, avg = 4.1s, dev = 1.2s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 6.0s Stats over 20 runs: max = 6.0s, min = 2.9s, avg = 4.3s, dev = 1.0s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 8.3s Stats over 20 runs: max = 8.3s, min = 2.8s, avg = 3.8s, dev = 1.6s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 9.5s Stats over 20 runs: max = 9.5s, min = 2.5s, avg = 4.7s, dev = 1.8s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 7.9s Stats over 20 runs: max = 7.9s, min = 6.1s, avg = 7.0s, dev = 0.6s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 13.3s Stats over 20 runs: max = 13.3s, min = 10.4s, avg = 11.4s, dev = 0.6s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 11.2s Stats over 20 runs: max = 11.2s, min = 9.2s, avg = 10.2s, dev = 0.6s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 41.3s Stats over 20 runs: max = 41.3s, min = 6.6s, avg = 15.0s, dev = 10.6s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 20.8s Stats over 20 runs: max = 20.8s, min = 14.7s, avg = 17.8s, dev = 1.7s //tensorflow/python/kernel_tests:metrics_test PASSED in 36.1s Stats over 20 runs: max = 36.1s, min = 5.9s, avg = 15.7s, dev = 8.4s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 5.6s Stats over 20 runs: max = 5.6s, min = 3.1s, avg = 4.2s, dev = 1.0s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 31.4s Stats over 20 runs: max = 31.4s, min = 2.9s, avg = 10.7s, dev = 9.6s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 87.0s Stats over 20 runs: max = 87.0s, min = 25.4s, avg = 51.8s, dev = 19.7s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 6.4s Stats over 20 runs: max = 6.4s, min = 3.2s, avg = 4.5s, dev = 1.2s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 11.4s Stats over 20 runs: max = 11.4s, min = 6.1s, avg = 8.8s, dev = 2.0s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 105.4s Stats over 20 runs: max = 105.4s, min = 28.6s, avg = 74.4s, dev = 23.7s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 17.0s Stats over 20 runs: max = 17.0s, min = 3.1s, avg = 7.6s, dev = 4.7s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 16.6s Stats over 20 runs: max = 16.6s, min = 6.6s, avg = 10.9s, dev = 3.4s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 68.7s Stats over 20 runs: max = 68.7s, min = 49.6s, avg = 56.8s, dev = 6.5s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 56.0s Stats over 20 runs: max = 56.0s, min = 4.3s, avg = 23.6s, dev = 17.6s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 21.9s Stats over 20 runs: max = 21.9s, min = 2.9s, avg = 5.8s, dev = 4.2s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 19.7s Stats over 24 runs: max = 19.7s, min = 8.5s, avg = 13.9s, dev = 3.0s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 21.9s Stats over 24 runs: max = 21.9s, min = 6.5s, avg = 12.8s, dev = 4.4s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 15.1s Stats over 24 runs: max = 15.1s, min = 3.3s, avg = 7.2s, dev = 3.5s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 7.0s Stats over 25 runs: max = 7.0s, min = 6.1s, avg = 6.5s, dev = 0.2s //tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 31.3s Stats over 25 runs: max = 31.3s, min = 6.1s, avg = 9.7s, dev = 6.4s //tensorflow/dtensor/python/tests:spmd_test_cpu PASSED in 26.6s Stats over 25 runs: max = 26.6s, min = 19.1s, avg = 23.1s, dev = 1.9s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 7.0s Stats over 30 runs: max = 7.0s, min = 6.2s, avg = 6.6s, dev = 0.2s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 13.5s Stats over 30 runs: max = 13.5s, min = 11.7s, avg = 12.6s, dev = 0.5s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 25.2s Stats over 30 runs: max = 25.2s, min = 2.6s, avg = 8.9s, dev = 5.9s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 12.3s Stats over 31 runs: max = 12.3s, min = 8.3s, avg = 10.4s, dev = 1.2s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 13.1s Stats over 32 runs: max = 13.1s, min = 7.2s, avg = 9.1s, dev = 1.5s //tensorflow/python/data/experimental/kernel_tests/service:auto_shard_test PASSED in 17.7s Stats over 32 runs: max = 17.7s, min = 3.9s, avg = 10.5s, dev = 3.2s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 26.8s Stats over 32 runs: max = 26.8s, min = 6.6s, avg = 17.6s, dev = 5.2s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 8.3s Stats over 40 runs: max = 8.3s, min = 6.7s, avg = 7.5s, dev = 0.4s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 10.5s Stats over 40 runs: max = 10.5s, min = 7.9s, avg = 9.1s, dev = 0.8s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 36.4s Stats over 50 runs: max = 36.4s, min = 2.5s, avg = 9.5s, dev = 7.5s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 9.5s Stats over 50 runs: max = 9.5s, min = 6.7s, avg = 7.8s, dev = 0.7s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 11.6s Stats over 50 runs: max = 11.6s, min = 8.3s, avg = 9.8s, dev = 0.8s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 14.7s Stats over 50 runs: max = 14.7s, min = 7.5s, avg = 9.8s, dev = 1.9s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 11.0s Stats over 50 runs: max = 11.0s, min = 3.8s, avg = 7.1s, dev = 2.1s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 6.1s Stats over 50 runs: max = 6.1s, min = 2.6s, avg = 3.3s, dev = 0.9s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 5.6s Stats over 50 runs: max = 5.6s, min = 2.5s, avg = 3.1s, dev = 0.7s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 25.8s Stats over 50 runs: max = 25.8s, min = 6.6s, avg = 13.3s, dev = 5.3s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 11.6s Stats over 50 runs: max = 11.6s, min = 2.6s, avg = 3.8s, dev = 1.5s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 11.9s Stats over 50 runs: max = 11.9s, min = 2.6s, avg = 4.2s, dev = 2.4s Executed 3116 out of 3567 tests: 3115 tests pass, 264 fail to build, 1 fails locally and 187 were skipped. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring TASK [tensorflow_in_container : (Python 3.8) save tests output to file] ******** Thursday 02 February 2023 03:49:58 +0000 (1:04:18.364) 1:53:50.257 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) save tests stderr output to file] *** Thursday 02 February 2023 03:49:59 +0000 (0:00:00.724) 1:53:50.981 ***** fatal: [localhost]: FAILED! => msg: 'failed to transfer file to /home/buildslave/.ansible/tmp/ansible-tmp-1675309799.3523083-2084257-35963005231747/source: [Errno 28] No space left on device: b''/home/buildslave/.ansible/tmp/ansible-local-3441967wzfivy1g/tmpm16g75q3/log-stderr.j2'' -> b''/home/buildslave/.ansible/tmp/ansible-tmp-1675309799.3523083-2084257-35963005231747/source''' PLAY RECAP ********************************************************************* localhost : ok=33 changed=26 unreachable=0 failed=1 skipped=7 rescued=0 ignored=1 Thursday 02 February 2023 03:49:59 +0000 (0:00:00.529) 1:53:51.511 ***** =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow-oneDNN-ACL git tests 3858.36s tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git 2800.13s tensorflow_in_container : (Python 3.8) build Python package ----------- 113.90s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 21.16s tensorflow_in_container : (Python 3.8) install Python packages --------- 10.78s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.71s tensorflow_in_container : (Python 3.8) start build container ------------ 3.51s Gathering Facts --------------------------------------------------------- 2.65s Create cache dirs ------------------------------------------------------- 1.38s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.21s tensorflow : Save git commit hash to file ------------------------------- 1.12s tensorflow_in_container : (Python 3.8) cleanup Bazel install directory --- 0.87s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.85s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.84s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.84s tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.75s tensorflow_in_container : (Python 3.8) save tests output to file -------- 0.72s tensorflow_in_container : (Python 3.8) create script to run tests ------- 0.71s tensorflow : Create readme file about unit tests ------------------------ 0.70s Build step 'Execute shell' marked build as failure

1 year, 10 months

1
5
0 0

Jenkins build is back to normal : Tensorflow Python package (manylinux2014 nightly) #682

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/682/disp…>

1 year, 10 months

1
0
0 0

Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #674

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/674/disp…> Changes: ------------------------------------------ Started by timer Started by user Marcin Juszkiewicz (marcin.juszkiewicz(a)linaro.org) Rebuilds build #673 Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on ldcg-aarch64-02 (aarch64 leg-aarch64) in workspace <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/> [ldcg-python-manylinux-tensorflow-nightly] $ /bin/bash /tmp/jenkins6257093834359270958.sh + dual_abi=false + cd <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/> + rm -rf '*.sh' configs wheels cache_upload + mkdir wheels cache_upload + git clone --depth 1 https://git.linaro.org/ci/job/configs.git Cloning into 'configs'... + cd configs + git log --pretty=oneline -1 7ffa9d4dcec4ff110237c2634c7fdf946e6bf31b ldcg-*-tensorflow: adapt search for failed tests + cd .. + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' true = true ']' + echo ' - "git"' + dual_abi=true + '[' false = true ']' + '[' '' = true ']' + '[' true == true ']' + ansible-galaxy collection install community.docker Starting galaxy collection install process Nothing to do. All requested collections are already installed. If you want to reinstall them, consider using `--force`. + cd configs/ldcg-python-manylinux-tensorflow/ansible/ + sed -i -es+/tmp/workspace+<https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/+g> vars/vars.yml + ansible-playbook playbooks/build-tf-dual-abi.yml [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' PLAY [Build TensorFlow in Dual ABI container] ********************************** TASK [Gathering Facts] ********************************************************* Thursday 02 February 2023 10:36:46 +0000 (0:00:00.056) 0:00:00.056 ***** ok: [localhost] TASK [Cleanup after previous build] ******************************************** Thursday 02 February 2023 10:36:49 +0000 (0:00:02.628) 0:00:02.685 ***** changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels) ok: [localhost] => (item=tensorflow) TASK [Create cache dirs] ******************************************************* Thursday 02 February 2023 10:36:50 +0000 (0:00:01.274) 0:00:03.959 ***** ok: [localhost] => (item=disk-cache) ok: [localhost] => (item=bazel-cache) changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels) TASK [Set dual abi variable] *************************************************** Thursday 02 February 2023 10:36:52 +0000 (0:00:01.399) 0:00:05.359 ***** ok: [localhost] TASK [Go through each TensorFlow version] ************************************** Thursday 02 February 2023 10:36:52 +0000 (0:00:00.035) 0:00:05.394 ***** skipping: [localhost] => (item={'key': '2.11', 'value': {'tensorflow_version': '2.11.0', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.11.0', 'tensorboard_version': '==2.11.0', 'tensorflow_estimator_version': '==2.11.0', 'python_install_packages': ['packaging', 'portpicker', 'keras-nightly', 'tb-nightly', 'tf-estimator-nightly'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/training:server_lib_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.10', 'value': {'tensorflow_version': '2.10.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.10.0', 'tensorboard_version': '==2.10.1', 'tensorflow_estimator_version': '==2.10.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tensorflow/tests/...', '//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/tests:jit_test_cpu', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/training:server_lib_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.9', 'value': {'tensorflow_version': '2.9.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.9.0', 'tensorboard_version': '==2.9.0', 'tensorflow_estimator_version': '==2.9.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.8', 'value': {'tensorflow_version': '2.8.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.8.0', 'tensorboard_version': '==2.8.0', 'tensorflow_estimator_version': '==2.8.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/mlir/lite/tests:prepare-tf.mlir.test', '//tensorflow/compiler/mlir/tensorflow:dump_graph_test', '//tensorflow/core/common_runtime:direct_session_test', '//tensorflow/core/common_runtime:direct_session_with_debug_test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:quantize_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python:quantized_ops_test', '//tensorflow/python:script_ops_test', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.7', 'value': {'tensorflow_version': '2.7.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.5', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.7.0', 'tensorboard_version': '==2.7.0', 'tensorflow_estimator_version': '==2.7.0', 'python_install_packages': ['portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/java/...', '//tensorflow/lite/...', '//tensorflow/compiler/xla/python/...', '//tensorflow/compiler/xla/service/cpu/...', '//tensorflow/compiler/xla/tests/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/core/kernels:sparse_matmul_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/debug/cli:debugger_cli_common_test', '//tensorflow/python/debug/examples/v2:examples_v2_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/keras/mixed_precision:model_test', '//tensorflow/python/keras/preprocessing:image_test', '//tensorflow/python/kernel_tests:init_ops_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests:self_adjoint_eig_op_test', '//tensorflow/python/kernel_tests:sparse_matmul_op_test', '//tensorflow/python/lib/io:file_io_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python/ops/ragged:ragged_print_op_test', '//tensorflow/python/profiler/integration_test:profiler_api_test', '//tensorflow/python/profiler:profiler_v2_test', '//tensorflow/python/util:dispatch_test', '//tensorflow/python/util:traceback_utils_test', '//tensorflow/tools/api/tests:api_compatibility_test', '//tensorflow/tools/docs:tf_doctest', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.6', 'value': {'tensorflow_version': '2.6.5', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.6.0', 'tensorboard_version': '==2.6.0', 'tensorflow_estimator_version': '==2.6.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.5', 'value': {'tensorflow_version': '2.5.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.34.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.5.0', 'tensorboard_version': '==2.5.0', 'tensorflow_estimator_version': '==2.5.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.4', 'value': {'tensorflow_version': '2.4.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.3.3', 'grpcio_version': '~=1.32.0', 'h5py_version': '~=2.10', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.4.3', 'tensorboard_version': '==2.4.1', 'tensorflow_estimator_version': '==2.4.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '1.15', 'value': {'tensorflow_version': '1.15.5', 'bazel_version': '0.29.1', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.2.2', 'grpcio_version': '~=1.32.0', 'h5py_version': '==2.10', 'numpy_version': '~=1.18.0', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==1.2.2', 'tensorboard_version': '==1.15.0', 'tensorflow_estimator_version': '==1.15.2', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m']}}) TASK [tensorflow : Set TensorFlow and other package versions] ****************** Thursday 02 February 2023 10:36:52 +0000 (0:00:00.240) 0:00:05.635 ***** ok: [localhost] TASK [tensorflow : Set build dir for TensorFlow git] *************************** Thursday 02 February 2023 10:36:52 +0000 (0:00:00.080) 0:00:05.716 ***** ok: [localhost] TASK [tensorflow : Remove TensorFlow git sources from previous build] ********** Thursday 02 February 2023 10:36:52 +0000 (0:00:00.044) 0:00:05.760 ***** changed: [localhost] TASK [tensorflow : Fetch TensorFlow] ******************************************* Thursday 02 February 2023 10:36:56 +0000 (0:00:03.560) 0:00:09.321 ***** included: <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/confi…> for localhost TASK [tensorflow : Fetch TensorFlow git source] ******************************** Thursday 02 February 2023 10:36:56 +0000 (0:00:00.099) 0:00:09.420 ***** skipping: [localhost] TASK [tensorflow : Unpack TensorFlow git source] ******************************* Thursday 02 February 2023 10:36:56 +0000 (0:00:00.040) 0:00:09.461 ***** skipping: [localhost] TASK [tensorflow : Rename source dir for oneDNN build] ************************* Thursday 02 February 2023 10:36:56 +0000 (0:00:00.035) 0:00:09.496 ***** skipping: [localhost] TASK [tensorflow : Fetch TensorFlow from git] ********************************** Thursday 02 February 2023 10:36:56 +0000 (0:00:00.039) 0:00:09.536 ***** changed: [localhost] TASK [tensorflow : Set world write access to source] *************************** Thursday 02 February 2023 10:37:19 +0000 (0:00:23.403) 0:00:32.939 ***** changed: [localhost] TASK [tensorflow : Get oneline version of git log for this checkout] *********** Thursday 02 February 2023 10:37:20 +0000 (0:00:00.373) 0:00:33.313 ***** changed: [localhost] TASK [tensorflow : Show git log] *********************************************** Thursday 02 February 2023 10:37:20 +0000 (0:00:00.583) 0:00:33.896 ***** ok: [localhost] => git_log.stdout: '31f49a0006e78da1d6cc022909ccc8db448febe1 Merge pull request #58518 from Tessil:toupstream/support_for_transform_params_lut_populate' TASK [tensorflow : Record git commit hash to variable] ************************* Thursday 02 February 2023 10:37:20 +0000 (0:00:00.042) 0:00:33.939 ***** ok: [localhost] TASK [tensorflow : Save git commit hash to file] ******************************* Thursday 02 February 2023 10:37:20 +0000 (0:00:00.061) 0:00:34.000 ***** changed: [localhost] TASK [Build Bazel] ************************************************************* Thursday 02 February 2023 10:37:21 +0000 (0:00:01.143) 0:00:35.143 ***** skipping: [localhost] TASK [Build TensorFlow for each Python version] ******************************** Thursday 02 February 2023 10:37:21 +0000 (0:00:00.036) 0:00:35.180 ***** skipping: [localhost] => (item=3.8) skipping: [localhost] => (item=3.9) skipping: [localhost] => (item=3.10) TASK [Build TensorFlow for each Python version (dual abi)] ********************* Thursday 02 February 2023 10:37:22 +0000 (0:00:00.081) 0:00:35.262 ***** TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Thursday 02 February 2023 10:37:22 +0000 (0:00:00.457) 0:00:35.719 ***** changed: [localhost] TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] *** Thursday 02 February 2023 10:37:23 +0000 (0:00:00.628) 0:00:36.347 ***** skipping: [localhost] TASK [Fetch TensorFlow] ******************************************************** Thursday 02 February 2023 10:37:23 +0000 (0:00:00.036) 0:00:36.384 ***** skipping: [localhost] TASK [(Python 3.8) patch TensorFlow tree] ************************************** Thursday 02 February 2023 10:37:23 +0000 (0:00:00.036) 0:00:36.421 ***** TASK [tensorflow : Create linklibs shell script] ******************************* Thursday 02 February 2023 10:37:23 +0000 (0:00:00.142) 0:00:36.563 ***** changed: [localhost] TASK [tensorflow : Create readme file about unit tests] ************************ Thursday 02 February 2023 10:37:24 +0000 (0:00:00.695) 0:00:37.259 ***** changed: [localhost] TASK [tensorflow : Add to the copied files] ************************************ Thursday 02 February 2023 10:37:24 +0000 (0:00:00.704) 0:00:37.963 ***** changed: [localhost] TASK [tensorflow : Add to the long_description in setup.py] ******************** Thursday 02 February 2023 10:37:25 +0000 (0:00:00.572) 0:00:38.536 ***** changed: [localhost] TASK [tensorflow : Use nightly package requirements] *************************** Thursday 02 February 2023 10:37:25 +0000 (0:00:00.554) 0:00:39.090 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) start build container] ************ Thursday 02 February 2023 10:37:26 +0000 (0:00:00.390) 0:00:39.481 ***** fatal: [localhost]: FAILED! => changed=false msg: 'Error removing container cfe923d833ccaa5768a3680b761ff4eef403ae2c6258e4ebb4c90f0d436990cf: UnixHTTPConnectionPool(host=''localhost'', port=None): Read timed out. (read timeout=60)' PLAY RECAP ********************************************************************* localhost : ok=20 changed=13 unreachable=0 failed=1 skipped=7 rescued=0 ignored=0 Thursday 02 February 2023 10:38:48 +0000 (0:01:22.318) 0:02:01.799 ***** =============================================================================== tensorflow_in_container : (Python 3.8) start build container ----------- 82.32s tensorflow : Fetch TensorFlow from git --------------------------------- 23.40s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.56s Gathering Facts --------------------------------------------------------- 2.63s Create cache dirs ------------------------------------------------------- 1.40s Cleanup after previous build -------------------------------------------- 1.27s tensorflow : Save git commit hash to file ------------------------------- 1.14s tensorflow : Create readme file about unit tests ------------------------ 0.70s tensorflow : Create linklibs shell script ------------------------------- 0.70s tensorflow_in_container : Reset checkout to clean state ----------------- 0.63s tensorflow : Get oneline version of git log for this checkout ----------- 0.58s tensorflow : Add to the copied files ------------------------------------ 0.57s tensorflow : Add to the long_description in setup.py -------------------- 0.55s Build TensorFlow for each Python version (dual abi) --------------------- 0.46s tensorflow : Use nightly package requirements --------------------------- 0.39s tensorflow : Set world write access to source --------------------------- 0.37s Go through each TensorFlow version -------------------------------------- 0.24s (Python 3.8) patch TensorFlow tree -------------------------------------- 0.14s tensorflow : Fetch TensorFlow ------------------------------------------- 0.10s Build TensorFlow for each Python version -------------------------------- 0.08s Build step 'Execute shell' marked build as failure

1 year, 10 months

1
6
0 0

2024

2023

2022

2021

ldcg-ai-ml February 2023