See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/349/display/redirect
Changes:
------------------------------------------ [...truncated 16.71 KB...]
TASK [tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build] *** Friday 24 February 2023 01:56:10 +0000 (0:00:00.044) 0:00:05.786 ******* changed: [localhost]
TASK [tensorflow : Fetch TensorFlow] ******************************************* Friday 24 February 2023 01:56:13 +0000 (0:00:03.453) 0:00:09.239 ******* included: https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/ws/configs/ldcg-python-manylinux-tensorflow/ansible/roles/tensorflow/tasks/fetch.yml for localhost
TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL git source] ********************* Friday 24 February 2023 01:56:13 +0000 (0:00:00.115) 0:00:09.354 ******* skipping: [localhost]
TASK [tensorflow : Unpack TensorFlow-oneDNN-ACL git source] ******************** Friday 24 February 2023 01:56:13 +0000 (0:00:00.040) 0:00:09.395 ******* skipping: [localhost]
TASK [tensorflow : Rename source dir for oneDNN build] ************************* Friday 24 February 2023 01:56:13 +0000 (0:00:00.037) 0:00:09.432 ******* skipping: [localhost]
TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL from git] *********************** Friday 24 February 2023 01:56:13 +0000 (0:00:00.038) 0:00:09.471 ******* changed: [localhost]
TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL from git at commit] ************* Friday 24 February 2023 01:56:35 +0000 (0:00:21.968) 0:00:31.440 ******* skipping: [localhost]
TASK [tensorflow : Set world write access to source] *************************** Friday 24 February 2023 01:56:35 +0000 (0:00:00.036) 0:00:31.477 ******* changed: [localhost]
TASK [tensorflow : Get oneline version of git log for this checkout] *********** Friday 24 February 2023 01:56:36 +0000 (0:00:00.374) 0:00:31.852 ******* changed: [localhost]
TASK [tensorflow : Show git log] *********************************************** Friday 24 February 2023 01:56:36 +0000 (0:00:00.585) 0:00:32.438 ******* ok: [localhost] => git_log.stdout: 3f43b4eb7c183b3ce077dbee5b06c1b1ac201d72 Support quantizing models that use asset files to initialize resources.
TASK [tensorflow : Record git commit hash to variable] ************************* Friday 24 February 2023 01:56:36 +0000 (0:00:00.044) 0:00:32.482 ******* ok: [localhost]
TASK [tensorflow : Save git commit hash to file] ******************************* Friday 24 February 2023 01:56:36 +0000 (0:00:00.062) 0:00:32.544 ******* changed: [localhost]
TASK [Build Bazel] ************************************************************* Friday 24 February 2023 01:56:38 +0000 (0:00:01.146) 0:00:33.691 ******* skipping: [localhost]
TASK [Build TensorFlow for each Python version] ******************************** Friday 24 February 2023 01:56:38 +0000 (0:00:00.059) 0:00:33.751 ******* skipping: [localhost] => (item=3.8) skipping: [localhost] => (item=3.9) skipping: [localhost] => (item=3.10) skipping: [localhost] => (item=3.11)
TASK [Build TensorFlow for each Python version (dual abi)] ********************* Friday 24 February 2023 01:56:38 +0000 (0:00:00.055) 0:00:33.807 *******
TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Friday 24 February 2023 01:56:38 +0000 (0:00:00.632) 0:00:34.439 ******* changed: [localhost]
TASK [tensorflow_in_container : Remove TensorFlow-oneDNN-ACL git sources from previous build] *** Friday 24 February 2023 01:56:39 +0000 (0:00:00.828) 0:00:35.268 ******* skipping: [localhost]
TASK [Fetch TensorFlow] ******************************************************** Friday 24 February 2023 01:56:39 +0000 (0:00:00.037) 0:00:35.306 ******* skipping: [localhost]
TASK [(Python 3.8) patch TensorFlow tree] ************************************** Friday 24 February 2023 01:56:39 +0000 (0:00:00.037) 0:00:35.344 *******
TASK [tensorflow : Create linklibs shell script] ******************************* Friday 24 February 2023 01:56:39 +0000 (0:00:00.172) 0:00:35.516 ******* changed: [localhost]
TASK [tensorflow : Create readme file about unit tests] ************************ Friday 24 February 2023 01:56:40 +0000 (0:00:00.692) 0:00:36.209 ******* changed: [localhost]
TASK [tensorflow : Add to the copied files] ************************************ Friday 24 February 2023 01:56:41 +0000 (0:00:00.700) 0:00:36.909 ******* changed: [localhost]
TASK [tensorflow : Add to the long_description in setup.py] ******************** Friday 24 February 2023 01:56:41 +0000 (0:00:00.596) 0:00:37.506 ******* changed: [localhost]
TASK [tensorflow : Use nightly package requirements] *************************** Friday 24 February 2023 01:56:42 +0000 (0:00:00.581) 0:00:38.088 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) start build container] ************ Friday 24 February 2023 01:56:42 +0000 (0:00:00.392) 0:00:38.480 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir] *** Friday 24 February 2023 01:57:18 +0000 (0:00:35.153) 0:01:13.634 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) create link for bazel cache] ****** Friday 24 February 2023 01:57:19 +0000 (0:00:01.227) 0:01:14.862 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) create link for bazelisk cache] *** Friday 24 February 2023 01:57:20 +0000 (0:00:00.814) 0:01:15.677 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) create link for pip cache] ******** Friday 24 February 2023 01:57:20 +0000 (0:00:00.822) 0:01:16.499 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) copy upper constraints] *********** Friday 24 February 2023 01:57:21 +0000 (0:00:00.788) 0:01:17.288 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) install Python packages] ********** Friday 24 February 2023 01:57:22 +0000 (0:00:00.718) 0:01:18.006 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git] *** Friday 24 February 2023 01:57:54 +0000 (0:00:31.677) 0:01:49.683 ******* fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- Extracting Bazel installation... Starting local Bazel server and connecting to it... INFO: Invocation ID: 8c55d19e-948a-4502-964f-50a104c0c7bf INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Reading rc options for 'build' from /usertools/aarch64.bazelrc: 'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/bin/python3 --action_env PYTHON_LIB_PATH=/usr/lib/tf_python --python_path=/usr/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --distinct_host_configuration=false --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3 INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64.bazelrc: --disk_cache=/tf/cache INFO: Found applicable config definition build:ambe in file /usertools/aarch64.bazelrc: --distinct_host_configuration=false --flaky_test_attempts=3 --action_env=PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin --host_crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --extra_toolchains=@ml2014_aarch64_config_aarch64//crosstool:toolchain-linux-aarch64 --extra_execution_platforms=@ml2014_aarch64_config_aarch64_platform//:platform --host_platform=@ml2014_aarch64_config_aarch64_platform//:platform --platforms=@ml2014_aarch64_config_aarch64_platform//:platform --repo_env=TF_PYTHON_CONFIG_REPO=@ml2014_aarch64_config_python INFO: Found applicable config definition build:mkl_aarch64_threadpool in file /tf/tensorflow/.bazelrc: --define=build_with_mkl_aarch64=true -c opt INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/tensorflow/r... failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-pr... failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured) WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/openxla/stab... failed: class java.io.FileNotFoundException GET returned 404 Not Found Analyzing: target //tensorflow/tools/pip_package:build_pip_package (289 packages loaded, 4306 targets configured) INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (593 packages loaded, 37030 targets configured). INFO: Found 1 target... [0 / 183] [Prepa] Creating source manifest for //tensorflow/lite/python:tflite_convert ... (5 actions, 0 running) [12,136 / 23,108] Compiling tensorflow/lite/delegates/xnnpack/quantization_util.cc; 11s local, remote-cache ... (111 actions, 110 running) [12,210 / 23,108] Compiling tensorflow/compiler/xla/literal_comparison.cc; 21s local, remote-cache ... (111 actions, 110 running) [12,294 / 23,108] Compiling tensorflow/compiler/xla/literal.cc; 36s local, remote-cache ... (111 actions, 110 running) [12,387 / 23,108] Compiling tensorflow/compiler/xla/literal.cc; 52s local, remote-cache ... (112 actions running) [12,622 / 23,108] Compiling tensorflow/compiler/xla/hlo/ir/hlo_instruction.cc; 38s local, remote-cache ... (112 actions running) [12,873 / 23,108] Compiling tensorflow/compiler/xla/service/memory_space_assignment.cc; 51s local, remote-cache ... (112 actions running) [13,013 / 23,108] Compiling tensorflow/compiler/xla/service/algebraic_simplifier.cc; 63s local, remote-cache ... (112 actions running) [13,169 / 23,108] Compiling tensorflow/python/client/tf_session_wrapper.cc; 55s local, remote-cache ... (112 actions running) [13,383 / 23,108] Compiling tensorflow/core/kernels/rnn/lstm_ops.cc; 66s local, remote-cache ... (112 actions running) [13,695 / 23,108] Compiling tensorflow/core/kernels/padding_fifo_queue.cc; 52s local, remote-cache ... (112 actions running) [13,919 / 23,108] Compiling tensorflow/core/kernels/lrn_op.cc; 66s local, remote-cache ... (112 actions running) [14,212 / 23,108] Compiling tensorflow/core/kernels/image/mirror_pad_op_cpu_impl_5.cc; 53s local, remote-cache ... (112 actions running) [14,634 / 23,108] Compiling tensorflow/core/kernels/training_ops.cc; 64s local, remote-cache ... (112 actions running) [17,905 / 24,452] Compiling tensorflow/core/kernels/training_ops.cc; 131s local, remote-cache ... (112 actions running) [18,516 / 24,452] Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 42s local, remote-cache ... (112 actions running) [18,910 / 24,452] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops.cc; 66s local, remote-cache ... (112 actions running) [19,369 / 24,452] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops.cc; 168s local, remote-cache ... (111 actions, 110 running) [19,627 / 24,452] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops.cc; 285s local, remote-cache ... (112 actions running) [19,805 / 24,452] Compiling tensorflow/core/kernels/cwise_op_select.cc; 181s local, remote-cache ... (112 actions running) [20,435 / 24,452] Compiling tensorflow/core/kernels/matmul_op_real.cc; 240s local, remote-cache ... (112 actions running) [21,299 / 24,452] Compiling tensorflow/core/kernels/matmul_op_real.cc; 418s local, remote-cache ... (112 actions running) [22,060 / 24,452] Compiling tensorflow/compiler/xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 135s local, remote-cache ... (112 actions running) [22,817 / 24,452] Compiling tensorflow/dtensor/mlir/expansions/iterator_spmd_expander.cc; 40s local, remote-cache ... (112 actions running) [24,042 / 24,484] Compiling tensorflow/dtensor/cc/dtensor_device.cc; 60s local, remote-cache ... (111 actions, 110 running) [24,592 / 24,659] Linking tensorflow/libtensorflow_cc.so.2.13.0; 161s local, remote-cache ERROR: /tf/tensorflow/tensorflow/BUILD:1635:19: Executing genrule //tensorflow:tf_python_api_gen_v2 failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped) Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/tools/api/generator/create_python_api.py", line 22, in <module> from tensorflow.python.tools.api.generator import doc_srcs File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/__init__.py", line 37, in <module> from tensorflow.python.eager import context File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/eager/context.py", line 28, in <module> from tensorflow.core.framework import function_pb2 File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/core/framework/function_pb2.py", line 5, in <module> from google.protobuf.internal import builder as _builder ModuleNotFoundError: No module named 'google.protobuf' Target //tensorflow/tools/pip_package:build_pip_package failed to build Use --verbose_failures to see the command lines of failed build steps. ERROR: /tf/tensorflow/tensorflow/python/tools/BUILD:282:10 Middleman _middlemen/tensorflow_Spython_Stools_Sprint_Uselective_Uregistration_Uheader-runfiles failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped) INFO: Elapsed time: 2802.608s, Critical Path: 1106.80s INFO: 24658 processes: 11508 disk cache hit, 5600 internal, 7550 local. FAILED: Build did NOT complete successfully FAILED: Build did NOT complete successfully stderr_lines: <omitted> stdout: '' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=27 changed=20 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0
Friday 24 February 2023 02:44:37 +0000 (0:46:43.868) 0:48:33.552 ******* =============================================================================== tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git 2803.87s tensorflow_in_container : (Python 3.8) start build container ----------- 35.15s tensorflow_in_container : (Python 3.8) install Python packages --------- 31.68s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 21.97s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.45s Gathering Facts --------------------------------------------------------- 2.63s Create cache dirs ------------------------------------------------------- 1.40s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.23s tensorflow : Save git commit hash to file ------------------------------- 1.15s tensorflow_in_container : Reset checkout to clean state ----------------- 0.83s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.82s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.81s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.79s tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.72s tensorflow : Create readme file about unit tests ------------------------ 0.70s tensorflow : Create linklibs shell script ------------------------------- 0.69s Build TensorFlow for each Python version (dual abi) --------------------- 0.63s tensorflow : Add to the copied files ------------------------------------ 0.60s tensorflow : Get oneline version of git log for this checkout ----------- 0.59s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/350/display/redirect
Changes:
------------------------------------------ [...truncated 1.20 MB...] Stats over 20 runs: max = 5.9s, min = 2.7s, avg = 3.7s, dev = 1.0s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 6.2s Stats over 20 runs: max = 6.2s, min = 2.9s, avg = 4.1s, dev = 1.0s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 11.4s Stats over 20 runs: max = 11.4s, min = 3.0s, avg = 4.7s, dev = 1.9s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 11.2s Stats over 20 runs: max = 11.2s, min = 2.8s, avg = 4.3s, dev = 2.0s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 6.5s Stats over 20 runs: max = 6.5s, min = 6.1s, avg = 6.3s, dev = 0.1s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 11.9s Stats over 20 runs: max = 11.9s, min = 8.5s, avg = 10.3s, dev = 0.9s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 10.3s Stats over 20 runs: max = 10.3s, min = 8.6s, avg = 9.4s, dev = 0.5s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 42.0s Stats over 20 runs: max = 42.0s, min = 6.5s, avg = 15.1s, dev = 10.6s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 17.1s Stats over 20 runs: max = 17.1s, min = 10.4s, avg = 13.3s, dev = 2.0s //tensorflow/python/kernel_tests:metrics_test PASSED in 40.3s Stats over 20 runs: max = 40.3s, min = 7.7s, avg = 17.6s, dev = 9.3s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 6.4s Stats over 20 runs: max = 6.4s, min = 2.5s, avg = 3.7s, dev = 1.3s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 12.0s Stats over 20 runs: max = 12.0s, min = 3.5s, avg = 6.2s, dev = 2.2s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 41.0s Stats over 20 runs: max = 41.0s, min = 2.8s, avg = 12.5s, dev = 12.6s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 104.7s Stats over 20 runs: max = 104.7s, min = 26.5s, avg = 55.9s, dev = 23.0s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 7.6s Stats over 20 runs: max = 7.6s, min = 3.2s, avg = 5.2s, dev = 1.4s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 14.0s Stats over 20 runs: max = 14.0s, min = 5.0s, avg = 9.6s, dev = 2.6s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 209.4s Stats over 20 runs: max = 209.4s, min = 31.9s, avg = 101.1s, dev = 51.2s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 20.8s Stats over 20 runs: max = 20.8s, min = 3.9s, avg = 10.1s, dev = 5.7s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 15.5s Stats over 20 runs: max = 15.5s, min = 5.3s, avg = 10.7s, dev = 3.4s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 15.4s Stats over 20 runs: max = 15.4s, min = 11.8s, avg = 13.1s, dev = 0.9s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 57.6s Stats over 20 runs: max = 57.6s, min = 4.5s, avg = 24.1s, dev = 18.5s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 24.4s Stats over 20 runs: max = 24.4s, min = 3.4s, avg = 8.1s, dev = 4.4s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 16.9s Stats over 24 runs: max = 16.9s, min = 4.4s, avg = 11.5s, dev = 3.0s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 19.6s Stats over 24 runs: max = 19.6s, min = 8.4s, avg = 12.8s, dev = 3.1s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 15.8s Stats over 24 runs: max = 15.8s, min = 3.2s, avg = 8.2s, dev = 3.7s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 7.5s Stats over 25 runs: max = 7.5s, min = 6.4s, avg = 6.9s, dev = 0.3s //tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 30.6s Stats over 25 runs: max = 30.6s, min = 6.3s, avg = 9.8s, dev = 6.4s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 7.3s Stats over 30 runs: max = 7.3s, min = 6.6s, avg = 6.9s, dev = 0.1s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 12.2s Stats over 30 runs: max = 12.2s, min = 10.7s, avg = 11.6s, dev = 0.3s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 7.4s Stats over 30 runs: max = 7.4s, min = 6.0s, avg = 6.5s, dev = 0.3s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 7.2s Stats over 30 runs: max = 7.2s, min = 6.1s, avg = 6.7s, dev = 0.3s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 42.0s Stats over 30 runs: max = 42.0s, min = 3.7s, avg = 13.8s, dev = 9.1s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 12.3s Stats over 31 runs: max = 12.3s, min = 6.6s, avg = 8.7s, dev = 1.4s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 8.8s Stats over 32 runs: max = 8.8s, min = 6.3s, avg = 7.3s, dev = 0.6s //tensorflow/python/data/experimental/kernel_tests/service:auto_shard_test PASSED in 14.3s Stats over 32 runs: max = 14.3s, min = 3.2s, avg = 9.0s, dev = 3.1s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 28.0s Stats over 32 runs: max = 28.0s, min = 8.4s, avg = 18.7s, dev = 4.4s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 9.3s Stats over 40 runs: max = 9.3s, min = 6.6s, avg = 8.4s, dev = 0.8s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 7.7s Stats over 40 runs: max = 7.7s, min = 6.4s, avg = 7.1s, dev = 0.3s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 8.9s Stats over 40 runs: max = 8.9s, min = 7.1s, avg = 8.0s, dev = 0.4s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 10.7s Stats over 40 runs: max = 10.7s, min = 6.5s, avg = 8.0s, dev = 0.9s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 89.4s Stats over 50 runs: max = 89.4s, min = 14.4s, avg = 38.8s, dev = 26.3s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 30.4s Stats over 50 runs: max = 30.4s, min = 2.8s, avg = 9.4s, dev = 6.2s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 35.9s Stats over 50 runs: max = 35.9s, min = 2.7s, avg = 9.2s, dev = 7.3s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 9.6s Stats over 50 runs: max = 9.6s, min = 6.7s, avg = 8.1s, dev = 0.8s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 11.8s Stats over 50 runs: max = 11.8s, min = 8.2s, avg = 10.5s, dev = 1.0s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 20.1s Stats over 50 runs: max = 20.1s, min = 9.2s, avg = 13.3s, dev = 2.8s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 13.5s Stats over 50 runs: max = 13.5s, min = 3.9s, avg = 7.9s, dev = 2.6s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 5.4s Stats over 50 runs: max = 5.4s, min = 2.7s, avg = 3.4s, dev = 0.7s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 5.9s Stats over 50 runs: max = 5.9s, min = 2.5s, avg = 3.4s, dev = 0.9s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 24.0s Stats over 50 runs: max = 24.0s, min = 6.5s, avg = 12.8s, dev = 4.8s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 14.2s Stats over 50 runs: max = 14.2s, min = 2.8s, avg = 4.5s, dev = 1.7s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 11.0s Stats over 50 runs: max = 11.0s, min = 2.7s, avg = 4.1s, dev = 1.9s
Executed 3597 out of 3597 tests: 3593 tests pass and 4 fail locally. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring
TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages] *** Saturday 25 February 2023 04:02:10 +0000 (1:10:50.840) 2:06:05.485 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) save list of installed Python packages] *** Saturday 25 February 2023 04:02:12 +0000 (0:00:02.050) 2:06:07.536 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) save tests output to file] ******** Saturday 25 February 2023 04:02:12 +0000 (0:00:00.697) 2:06:08.234 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) save tests stderr output to file] *** Saturday 25 February 2023 04:02:13 +0000 (0:00:00.714) 2:06:08.948 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) Extract number of tests run] ****** Saturday 25 February 2023 04:02:14 +0000 (0:00:00.704) 2:06:09.652 ***** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.8) Show number of tests run] ********* Saturday 25 February 2023 04:02:14 +0000 (0:00:00.110) 2:06:09.763 ***** ok: [localhost] => ut_tests_line: ''
TASK [tensorflow_in_container : (Python 3.8) Extract failed tests] ************* Saturday 25 February 2023 04:02:14 +0000 (0:00:00.080) 2:06:09.843 ***** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.8) Show which tests failed] ********** Saturday 25 February 2023 04:02:14 +0000 (0:00:00.079) 2:06:09.923 ***** ok: [localhost] => tests_failed: 'FAILED: '
TASK [tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one] *** Saturday 25 February 2023 04:02:14 +0000 (0:00:00.049) 2:06:09.972 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) Get list of wheel files] ********** Saturday 25 February 2023 04:10:23 +0000 (0:08:09.065) 2:14:19.037 ***** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.8) Get filename of latest wheel] ***** Saturday 25 February 2023 04:10:24 +0000 (0:00:00.601) 2:14:19.639 ***** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.8) move manylinux2014 wheel outside] *** Saturday 25 February 2023 04:10:24 +0000 (0:00:00.067) 2:14:19.706 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) Remove manylinux2014 wheel] ******* Saturday 25 February 2023 04:10:26 +0000 (0:00:02.522) 2:14:22.229 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) stop build container] ************* Saturday 25 February 2023 04:10:27 +0000 (0:00:00.422) 2:14:22.651 ***** changed: [localhost]
TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Saturday 25 February 2023 04:14:12 +0000 (0:03:45.542) 2:18:08.194 ***** changed: [localhost]
TASK [tensorflow_in_container : Remove TensorFlow-oneDNN-ACL git sources from previous build] *** Saturday 25 February 2023 04:14:13 +0000 (0:00:00.625) 2:18:08.819 ***** skipping: [localhost]
TASK [Fetch TensorFlow] ******************************************************** Saturday 25 February 2023 04:14:13 +0000 (0:00:00.040) 2:18:08.859 ***** skipping: [localhost]
TASK [(Python 3.9) patch TensorFlow tree] ************************************** Saturday 25 February 2023 04:14:13 +0000 (0:00:00.039) 2:18:08.899 *****
TASK [tensorflow : Create linklibs shell script] ******************************* Saturday 25 February 2023 04:14:13 +0000 (0:00:00.175) 2:18:09.075 ***** changed: [localhost]
TASK [tensorflow : Create readme file about unit tests] ************************ Saturday 25 February 2023 04:14:14 +0000 (0:00:00.693) 2:18:09.769 ***** changed: [localhost]
TASK [tensorflow : Add to the copied files] ************************************ Saturday 25 February 2023 04:14:15 +0000 (0:00:00.704) 2:18:10.473 ***** changed: [localhost]
TASK [tensorflow : Add to the long_description in setup.py] ******************** Saturday 25 February 2023 04:14:15 +0000 (0:00:00.369) 2:18:10.842 ***** changed: [localhost]
TASK [tensorflow : Use nightly package requirements] *************************** Saturday 25 February 2023 04:14:15 +0000 (0:00:00.363) 2:18:11.206 ***** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper constraints] *********** Saturday 25 February 2023 04:14:16 +0000 (0:00:00.394) 2:18:11.601 ***** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper-constraints to within Docker context] *** Saturday 25 February 2023 04:14:17 +0000 (0:00:00.758) 2:18:12.359 ***** fatal: [localhost]: FAILED! => changed=true cmd: - cp - https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/ws/wheels//upper-constraints.txt - https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/ws/configs/ldcg-python-manylinux-tensorflow/ delta: '0:00:00.003774' end: '2023-02-25 04:14:17.396763' msg: non-zero return code rc: 1 start: '2023-02-25 04:14:17.392989' stderr: 'cp: cannot create regular file ''https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/ws/configs/ldcg-python-manylinux-tensorflow/upper-constraints.txt'': Permission denied' stderr_lines: <omitted> stdout: '' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=54 changed=40 unreachable=0 failed=1 skipped=10 rescued=0 ignored=1
Saturday 25 February 2023 04:14:17 +0000 (0:00:00.344) 2:18:12.703 ***** =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow-oneDNN-ACL git tests 4250.84s tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git 3108.02s tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one - 489.07s tensorflow_in_container : (Python 3.8) stop build container ----------- 225.54s tensorflow_in_container : (Python 3.8) build Python package ----------- 114.70s tensorflow_in_container : (Python 3.8) build Python versioned container -- 45.10s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 22.98s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.69s tensorflow_in_container : (Python 3.8) move manylinux2014 wheel outside --- 2.52s tensorflow_in_container : (Python 3.8) collect list of installed Python packages --- 2.05s tensorflow_in_container : (Python 3.8) start build container ------------ 1.95s Gathering Facts --------------------------------------------------------- 1.62s tensorflow : Create readme file about unit tests ------------------------ 1.41s tensorflow : Create linklibs shell script ------------------------------- 1.39s Create cache dirs ------------------------------------------------------- 1.38s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.15s tensorflow : Save git commit hash to file ------------------------------- 1.12s tensorflow : Add to the copied files ------------------------------------ 0.93s tensorflow : Add to the long_description in setup.py -------------------- 0.92s Build step 'Execute shell' marked build as failure
ldcg-ai-ml@op-lists.linaro.org
-
ci_notify＠linaro.org