Build failed in Jenkins: Tensorflow oneDNN Python package (manylinux2014 nightly) #378
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/3…>
Changes:
------------------------------------------
[...truncated 90.18 MB...]
//tensorflow/compiler/tests:conv3d_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:data_format_ops_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:dynamic_stitch_test_cpu NO STATUS
//tensorflow/compiler/tests:eager_test_cpu NO STATUS
//tensorflow/compiler/tests:einsum_op_test_cpu NO STATUS
//tensorflow/compiler/tests:ftrl_ops_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:image_ops_jit_compile_test_cpu NO STATUS
//tensorflow/compiler/tests:jit_test_cpu NO STATUS
//tensorflow/compiler/tests:lrn_ops_test_cpu NO STATUS
//tensorflow/compiler/tests:lstm_test_cpu NO STATUS
//tensorflow/compiler/tests:manip_ops_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:placeholder_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:pooling_ops_test_cpu NO STATUS
//tensorflow/compiler/tests:reduce_window_test_cpu NO STATUS
//tensorflow/compiler/tests:self_adjoint_eig_op_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:sort_ops_test_cpu NO STATUS
//tensorflow/compiler/tests:tridiagonal_matmul_ops_test_cpu NO STATUS
//tensorflow/compiler/tests:tridiagonal_matmul_ops_test_cpu_mlir_bridge_test NO STATUS
NO STATUS
NO STATUS
//tensorflow/compiler/mlir/lite/experimental/tac/tests:fold-constants-to-subgraph.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-constant.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-add.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests:legalize-tf-assert.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests:optimize.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests:prepare-quantize-signed.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests:quantize-dynamic-range.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests:quantize-variables.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests:unfold-large-splat-constant.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/end2end:conv_2d_nchw.pbtxt.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:constants.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:external_constant.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:importer_test_min_max.cc.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:input_arrays.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:legacy_reshape.json.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:lstm.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:math.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:metadata.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:tf_entry_function.mlir.test NO STATUS
//tensorflow/compiler/mlir/quantization/tensorflow/debugging:mlir_dump_test NO STATUS
//tensorflow/compiler/mlir/quantization/tensorflow/tests:convert_tf_quant_ops_to_mhlo.mlir.test NO STATUS
//tensorflow/compiler/mlir/quantization/tensorflow/tests:insert_quantized_functions.mlir.test NO STATUS
//tensorflow/compiler/mlir/quantization/tensorflow/tests:lift_quantizable_spots_as_functions_drq.mlir.test NO STATUS
//tensorflow/compiler/mlir/quantization/tensorflow/tests:prepare_quantize_ptq_per_channel.mlir.test NO STATUS
//tensorflow/compiler/mlir/quantization/tensorflow/tests:quantize_xla.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:batchmatmul_to_einsum.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:cluster_outlining.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:constant-fold.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:convert_to_legacy_compile_and_replicate_attributes.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:decompose_resource_ops.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:fused_kernel_matcher.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:graph_pruning.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:group_by_dialect.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:guarantee-all-funcs-one-use.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:layout_optimization_to_nchw.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:legalize_tfg_with_control_flow.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:lower_tf.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:parallel_execute_to_islands_legacy.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:promote_resources_to_args_functions.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:remove_unused_while_results.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:side-effect-analysis-test.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:stack_ops_decomposition.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:strip_tf_attributes.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:tf_executor_ops_invalid.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_deduplicate_bound_input_bindings.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:tpu-cluster-cleanup-attributes.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:tpu_identity_pruning.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:transpose-op.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:mlir-module-serialized-str-attr.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:result-sharding.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:serialized-mlir-module-str-attr-invalid.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:arg-as-fetch.pbtxt.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:device-arg-retval-attr.pbtxt.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-custom-operation.pbtxt.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-empty-tensor-content.pbtxt.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-function-call.pbtxt.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-undefined-output.pbtxt.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:shape-attrs.pbtxt.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:export_main_to_flib.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:optional_symbol_ref.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:output-shapes-attr.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:stringescape.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:tf-gradient-attr.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:tf-legacy-call.mlir.test NO STATUS
//tensorflow/compiler/mlir/tf2xla/tests:convert-mhlo-quant-to-int.mlir.test NO STATUS
//tensorflow/compiler/mlir/tf2xla/tests:legalize-tf-BatchMatMulV2.mlir.test NO STATUS
//tensorflow/compiler/mlir/tf2xla/tests:tfxla_device_specific_transformations_cpu.mlir.test NO STATUS
//tensorflow/compiler/mlir/tf2xla/transforms:tf2xla_rewriter_test NO STATUS
//tensorflow/compiler/mlir/tfr:op_reg_gen_test NO STATUS
//tensorflow/compiler/mlir/tools/kernel_gen/tests:parallel_loops_to_sequential.mlir.test NO STATUS
//tensorflow/compiler/tests:adagrad_test_cpu NO STATUS
//tensorflow/compiler/tests:conv3d_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:data_format_ops_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:dynamic_stitch_test_cpu NO STATUS
//tensorflow/compiler/tests:eager_test_cpu NO STATUS
//tensorflow/compiler/tests:einsum_op_test_cpu NO STATUS
//tensorflow/compiler/tests:ftrl_ops_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:image_ops_jit_compile_test_cpu NO STATUS
//tensorflow/compiler/tests:jit_test_cpu NO STATUS
//tensorflow/compiler/tests:lrn_ops_test_cpu NO STATUS
//tensorflow/compiler/tests:lstm_test_cpu NO STATUS
//tensorflow/compiler/tests:manip_ops_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:placeholder_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:pooling_ops_test_cpu NO STATUS
//tensorflow/compiler/tests:reduce_window_test_cpu NO STATUS
//tensorflow/compiler/tests:self_adjoint_eig_op_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:sort_ops_test_cpu NO STATUS
//tensorflow/compiler/tests:tridiagonal_matmul_ops_test_cpu NO STATUS
//tensorflow/compiler/tests:tridiagonal_matmul_ops_test_cpu_mlir_bridge_test NO STATUS
NO STATUS
NO STATUS
//tensorflow/compiler/mlir/lite/experimental/tac/tests:fold-constants-to-subgraph.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-constant.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-add.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests:legalize-tf-assert.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests:optimize.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests:prepare-quantize-signed.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests:quantize-dynamic-range.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests:quantize-variables.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests:unfold-large-splat-constant.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/end2end:conv_2d_nchw.pbtxt.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:constants.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:external_constant.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:importer_test_min_max.cc.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:input_arrays.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:legacy_reshape.json.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:lstm.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:math.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:metadata.mlir.test NO STATUS
//tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:tf_entry_function.mlir.test NO STATUS
//tensorflow/compiler/mlir/quantization/tensorflow/debugging:mlir_dump_test NO STATUS
//tensorflow/compiler/mlir/quantization/tensorflow/tests:convert_tf_quant_ops_to_mhlo.mlir.test NO STATUS
//tensorflow/compiler/mlir/quantization/tensorflow/tests:insert_quantized_functions.mlir.test NO STATUS
//tensorflow/compiler/mlir/quantization/tensorflow/tests:lift_quantizable_spots_as_functions_drq.mlir.test NO STATUS
//tensorflow/compiler/mlir/quantization/tensorflow/tests:prepare_quantize_ptq_per_channel.mlir.test NO STATUS
//tensorflow/compiler/mlir/quantization/tensorflow/tests:quantize_xla.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:batchmatmul_to_einsum.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:cluster_outlining.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:constant-fold.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:convert_to_legacy_compile_and_replicate_attributes.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:decompose_resource_ops.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:fused_kernel_matcher.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:graph_pruning.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:group_by_dialect.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:guarantee-all-funcs-one-use.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:layout_optimization_to_nchw.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:legalize_tfg_with_control_flow.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:lower_tf.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:parallel_execute_to_islands_legacy.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:promote_resources_to_args_functions.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:remove_unused_while_results.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:side-effect-analysis-test.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:stack_ops_decomposition.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:strip_tf_attributes.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:tf_executor_ops_invalid.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_deduplicate_bound_input_bindings.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:tpu-cluster-cleanup-attributes.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:tpu_identity_pruning.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests:transpose-op.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:mlir-module-serialized-str-attr.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:result-sharding.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:serialized-mlir-module-str-attr-invalid.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:arg-as-fetch.pbtxt.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:device-arg-retval-attr.pbtxt.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-custom-operation.pbtxt.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-empty-tensor-content.pbtxt.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-function-call.pbtxt.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-undefined-output.pbtxt.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:shape-attrs.pbtxt.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:export_main_to_flib.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:optional_symbol_ref.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:output-shapes-attr.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:stringescape.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:tf-gradient-attr.mlir.test NO STATUS
//tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:tf-legacy-call.mlir.test NO STATUS
//tensorflow/compiler/mlir/tf2xla/tests:convert-mhlo-quant-to-int.mlir.test NO STATUS
//tensorflow/compiler/mlir/tf2xla/tests:legalize-tf-BatchMatMulV2.mlir.test NO STATUS
//tensorflow/compiler/mlir/tf2xla/tests:tfxla_device_specific_transformations_cpu.mlir.test NO STATUS
//tensorflow/compiler/mlir/tf2xla/transforms:tf2xla_rewriter_test NO STATUS
//tensorflow/compiler/mlir/tfr:op_reg_gen_test NO STATUS
//tensorflow/compiler/mlir/tools/kernel_gen/tests:parallel_loops_to_sequential.mlir.test NO STATUS
//tensorflow/compiler/tests:adagrad_test_cpu NO STATUS
//tensorflow/compiler/tests:conv3d_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:data_format_ops_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:dynamic_stitch_test_cpu NO STATUS
//tensorflow/compiler/tests:eager_test_cpu NO STATUS
//tensorflow/compiler/tests:einsum_op_test_cpu NO STATUS
//tensorflow/compiler/tests:ftrl_ops_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:image_ops_jit_compile_test_cpu NO STATUS
//tensorflow/compiler/tests:jit_test_cpu NO STATUS
//tensorflow/compiler/tests:lrn_ops_test_cpu NO STATUS
//tensorflow/compiler/tests:lstm_test_cpu NO STATUS
//tensorflow/compiler/tests:manip_ops_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:placeholder_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:pooling_ops_test_cpu NO STATUS
//tensorflow/compiler/tests:reduce_window_test_cpu NO STATUS
//tensorflow/compiler/tests:self_adjoint_eig_op_test_cpu_mlir_bridge_test NO STATUS
//tensorflow/compiler/tests:sort_ops_test_cpu NO STATUS
//tensorflow/compiler/tests:tridiagonal_matmul_ops_test_cpu NO STATUS
//tensorflow/compiler/tests:tridiagonal_matmul_ops_test_cpu_mlir_bridge_test NO STATUS
NO STATUS
NO STATUS
stdout_lines: <omitted>
...ignoring
TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages] ***
Saturday 25 March 2023 04:11:21 +0000 (1:22:28.879) 2:15:17.557 ********
fatal: [localhost]: FAILED! =>
msg: 'failed to transfer file to /home/buildslave/.ansible/tmp/ansible-tmp-1679717481.9321778-23873-80832813219643/AnsiballZ_docker_container_exec.py: [Errno 28] No space left on device: b''/home/buildslave/.ansible/tmp/ansible-tmp-1679717481.9321778-23873-80832813219643/AnsiballZ_docker_container_exec.py'''
PLAY RECAP *********************************************************************
localhost : ok=34 changed=25 unreachable=0 failed=1 skipped=8 rescued=0 ignored=1
Saturday 25 March 2023 04:11:21 +0000 (0:00:00.089) 2:15:17.647 ********
===============================================================================
tensorflow_in_container : (Python 3.8) run TensorFlow-oneDNN-ACL git tests 4948.88s
tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git 3000.24s
tensorflow_in_container : (Python 3.8) build Python package ----------- 117.01s
tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 22.16s
tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.90s
tensorflow_in_container : (Python 3.8) start build container ------------ 3.82s
tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build --- 2.11s
Gathering Facts --------------------------------------------------------- 1.64s
tensorflow_in_container : (Python 3.8) build Python versioned container --- 1.45s
Create cache dirs ------------------------------------------------------- 1.39s
Cleanup after previous build -------------------------------------------- 1.28s
tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.18s
tensorflow : Save git commit hash to file ------------------------------- 1.12s
tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.91s
tensorflow_in_container : (Python 3.8) cleanup Bazel install directory --- 0.90s
tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.82s
tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.82s
tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.72s
tensorflow : Create linklibs shell script ------------------------------- 0.72s
tensorflow_in_container : (Python 3.8) create script to run tests ------- 0.71s
Build step 'Execute shell' marked build as failure
10 hours
- 1
- 1
Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #737
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/737/disp…>
Changes:
------------------------------------------
[...truncated 168.51 KB...]
stderr_lines: <omitted>
stdout: |-
==================== Test output for //tensorflow/core/util/tensor_bundle:tensor_bundle_test:
[==========] Running 18 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 17 tests from TensorBundleTest
[ RUN ] TensorBundleTest.SwapBytes
[ OK ] TensorBundleTest.SwapBytes (0 ms)
[ RUN ] TensorBundleTest.Basic
[ OK ] TensorBundleTest.Basic (120 ms)
[ RUN ] TensorBundleTest.Endianness
[ OK ] TensorBundleTest.Endianness (213 ms)
[ RUN ] TensorBundleTest.PartitionedVariables
[ OK ] TensorBundleTest.PartitionedVariables (2 ms)
[ RUN ] TensorBundleTest.EquivalentSliceTest
[ OK ] TensorBundleTest.EquivalentSliceTest (2 ms)
[ RUN ] TensorBundleTest.NonStandardShapes
[ OK ] TensorBundleTest.NonStandardShapes (32 ms)
[ RUN ] TensorBundleTest.StringTensorsOldFormat
[ OK ] TensorBundleTest.StringTensorsOldFormat (0 ms)
[ RUN ] TensorBundleTest.StringTensors
tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:765: Failure
Expected equality of these values:
::tsl::OkStatus()
Which is: OK
(writer.Add("long_scalar", long_string_tensor))
Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate11559948317783239214; No space left on device
tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:768: Failure
Expected equality of these values:
::tsl::OkStatus()
Which is: OK
(writer.Add("floats", Constant_2x3<float>(16.18)))
Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate11559948317783239214; No space left on device
tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:769: Failure
Expected equality of these values:
::tsl::OkStatus()
Which is: OK
(writer.Finish())
Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate11559948317783239214; No space left on device
[ FAILED ] TensorBundleTest.StringTensors (47214 ms)
[ RUN ] TensorBundleTest.VariantTensors
[ OK ] TensorBundleTest.VariantTensors (3 ms)
[ RUN ] TensorBundleTest.DirectoryStructure
[ OK ] TensorBundleTest.DirectoryStructure (6 ms)
[ RUN ] TensorBundleTest.SortForSequentialAccess
[ OK ] TensorBundleTest.SortForSequentialAccess (5 ms)
[ RUN ] TensorBundleTest.Error
[ OK ] TensorBundleTest.Error (4 ms)
[ RUN ] TensorBundleTest.Checksum
[ OK ] TensorBundleTest.Checksum (88 ms)
[ RUN ] TensorBundleTest.TruncatedTensorContents
[ OK ] TensorBundleTest.TruncatedTensorContents (31 ms)
[ RUN ] TensorBundleTest.HeaderEntry
[ OK ] TensorBundleTest.HeaderEntry (2 ms)
[ RUN ] TensorBundleTest.VersionTest
[ OK ] TensorBundleTest.VersionTest (38 ms)
[ RUN ] TensorBundleTest.LargeVariableLoadingTest
[ OK ] TensorBundleTest.LargeVariableLoadingTest (4 ms)
[----------] 17 tests from TensorBundleTest (47772 ms total)
[----------] 1 test from TensorBundleAlignmentTest
[ RUN ] TensorBundleAlignmentTest.AlignmentTest
[ OK ] TensorBundleAlignmentTest.AlignmentTest (2 ms)
[----------] 1 test from TensorBundleAlignmentTest (2 ms total)
[----------] Global test environment tear-down
[==========] 18 tests from 2 test suites ran. (47775 ms total)
[ PASSED ] 17 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] TensorBundleTest.StringTensors
1 FAILED TEST
================================================================================
==================== Test output for //tensorflow/core/util/tensor_bundle:tensor_bundle_test:
[==========] Running 18 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 17 tests from TensorBundleTest
[ RUN ] TensorBundleTest.SwapBytes
[ OK ] TensorBundleTest.SwapBytes (0 ms)
[ RUN ] TensorBundleTest.Basic
[ OK ] TensorBundleTest.Basic (106 ms)
[ RUN ] TensorBundleTest.Endianness
[ OK ] TensorBundleTest.Endianness (118 ms)
[ RUN ] TensorBundleTest.PartitionedVariables
[ OK ] TensorBundleTest.PartitionedVariables (3 ms)
[ RUN ] TensorBundleTest.EquivalentSliceTest
[ OK ] TensorBundleTest.EquivalentSliceTest (2 ms)
[ RUN ] TensorBundleTest.NonStandardShapes
[ OK ] TensorBundleTest.NonStandardShapes (34 ms)
[ RUN ] TensorBundleTest.StringTensorsOldFormat
[ OK ] TensorBundleTest.StringTensorsOldFormat (0 ms)
[ RUN ] TensorBundleTest.StringTensors
tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:765: Failure
Expected equality of these values:
::tsl::OkStatus()
Which is: OK
(writer.Add("long_scalar", long_string_tensor))
Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate17765104588851234696; No space left on device
tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:768: Failure
Expected equality of these values:
::tsl::OkStatus()
Which is: OK
(writer.Add("floats", Constant_2x3<float>(16.18)))
Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate17765104588851234696; No space left on device
tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:769: Failure
Expected equality of these values:
::tsl::OkStatus()
Which is: OK
(writer.Finish())
Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate17765104588851234696; No space left on device
[ FAILED ] TensorBundleTest.StringTensors (26756 ms)
[ RUN ] TensorBundleTest.VariantTensors
[ OK ] TensorBundleTest.VariantTensors (8 ms)
[ RUN ] TensorBundleTest.DirectoryStructure
[ OK ] TensorBundleTest.DirectoryStructure (9 ms)
[ RUN ] TensorBundleTest.SortForSequentialAccess
[ OK ] TensorBundleTest.SortForSequentialAccess (6 ms)
[ RUN ] TensorBundleTest.Error
[ OK ] TensorBundleTest.Error (4 ms)
[ RUN ] TensorBundleTest.Checksum
[ OK ] TensorBundleTest.Checksum (12 ms)
[ RUN ] TensorBundleTest.TruncatedTensorContents
[ OK ] TensorBundleTest.TruncatedTensorContents (2 ms)
[ RUN ] TensorBundleTest.HeaderEntry
[ OK ] TensorBundleTest.HeaderEntry (1 ms)
[ RUN ] TensorBundleTest.VersionTest
[ OK ] TensorBundleTest.VersionTest (0 ms)
[ RUN ] TensorBundleTest.LargeVariableLoadingTest
[ OK ] TensorBundleTest.LargeVariableLoadingTest (3 ms)
[----------] 17 tests from TensorBundleTest (27073 ms total)
[----------] 1 test from TensorBundleAlignmentTest
[ RUN ] TensorBundleAlignmentTest.AlignmentTest
[ OK ] TensorBundleAlignmentTest.AlignmentTest (2 ms)
[----------] 1 test from TensorBundleAlignmentTest (2 ms total)
[----------] Global test environment tear-down
[==========] 18 tests from 2 test suites ran. (27075 ms total)
[ PASSED ] 17 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] TensorBundleTest.StringTensors
1 FAILED TEST
================================================================================
==================== Test output for //tensorflow/core/util/tensor_bundle:tensor_bundle_test:
[==========] Running 18 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 17 tests from TensorBundleTest
[ RUN ] TensorBundleTest.SwapBytes
[ OK ] TensorBundleTest.SwapBytes (0 ms)
[ RUN ] TensorBundleTest.Basic
[ OK ] TensorBundleTest.Basic (177 ms)
[ RUN ] TensorBundleTest.Endianness
[ OK ] TensorBundleTest.Endianness (68 ms)
[ RUN ] TensorBundleTest.PartitionedVariables
[ OK ] TensorBundleTest.PartitionedVariables (1 ms)
[ RUN ] TensorBundleTest.EquivalentSliceTest
[ OK ] TensorBundleTest.EquivalentSliceTest (1 ms)
[ RUN ] TensorBundleTest.NonStandardShapes
[ OK ] TensorBundleTest.NonStandardShapes (17 ms)
[ RUN ] TensorBundleTest.StringTensorsOldFormat
[ OK ] TensorBundleTest.StringTensorsOldFormat (0 ms)
[ RUN ] TensorBundleTest.StringTensors
tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:765: Failure
Expected equality of these values:
::tsl::OkStatus()
Which is: OK
(writer.Add("long_scalar", long_string_tensor))
Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate7347782163562122469; No space left on device
tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:768: Failure
Expected equality of these values:
::tsl::OkStatus()
Which is: OK
(writer.Add("floats", Constant_2x3<float>(16.18)))
Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate7347782163562122469; No space left on device
tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:769: Failure
Expected equality of these values:
::tsl::OkStatus()
Which is: OK
(writer.Finish())
Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate7347782163562122469; No space left on device
[ FAILED ] TensorBundleTest.StringTensors (15126 ms)
[ RUN ] TensorBundleTest.VariantTensors
[ OK ] TensorBundleTest.VariantTensors (15 ms)
[ RUN ] TensorBundleTest.DirectoryStructure
[ OK ] TensorBundleTest.DirectoryStructure (6 ms)
[ RUN ] TensorBundleTest.SortForSequentialAccess
[ OK ] TensorBundleTest.SortForSequentialAccess (5 ms)
[ RUN ] TensorBundleTest.Error
[ OK ] TensorBundleTest.Error (4 ms)
[ RUN ] TensorBundleTest.Checksum
[ OK ] TensorBundleTest.Checksum (21 ms)
[ RUN ] TensorBundleTest.TruncatedTensorContents
[ OK ] TensorBundleTest.TruncatedTensorContents (3 ms)
[ RUN ] TensorBundleTest.HeaderEntry
[ OK ] TensorBundleTest.HeaderEntry (2 ms)
[ RUN ] TensorBundleTest.VersionTest
[ OK ] TensorBundleTest.VersionTest (1 ms)
[ RUN ] TensorBundleTest.LargeVariableLoadingTest
[ OK ] TensorBundleTest.LargeVariableLoadingTest (4 ms)
[----------] 17 tests from TensorBundleTest (15458 ms total)
[----------] 1 test from TensorBundleAlignmentTest
[ RUN ] TensorBundleAlignmentTest.AlignmentTest
[ OK ] TensorBundleAlignmentTest.AlignmentTest (2 ms)
[----------] 1 test from TensorBundleAlignmentTest (2 ms total)
[----------] Global test environment tear-down
[==========] 18 tests from 2 test suites ran. (15460 ms total)
[ PASSED ] 17 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] TensorBundleTest.StringTensors
1 FAILED TEST
================================================================================
stdout_lines: <omitted>
...ignoring
TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages] ***
Sunday 26 March 2023 02:56:59 +0100 (6:52:34.724) 7:46:54.782 **********
fatal: [localhost]: FAILED! => changed=false
msg: 'The container "tf-py3.8" has been paused (409 Client Error for http+docker://localhost/v1.41/containers/tf-py3.8/exec: Conflict ("Container b9fa8cc82fcbcbbe82ab960070266bcec4b648873c9bd44ec11f06e2f5606dc0 is not running"))'
PLAY RECAP *********************************************************************
localhost : ok=34 changed=25 unreachable=0 failed=1 skipped=8 rescued=0 ignored=1
Sunday 26 March 2023 02:57:09 +0100 (0:00:10.371) 7:47:05.153 **********
===============================================================================
tensorflow_in_container : (Python 3.8) run TensorFlow git tests ------ 24754.72s
tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 2889.81s
tensorflow_in_container : (Python 3.8) start build container ---------- 224.97s
tensorflow_in_container : (Python 3.8) build Python package ------------ 97.35s
tensorflow : Fetch TensorFlow from git --------------------------------- 22.72s
tensorflow_in_container : (Python 3.8) collect list of installed Python packages -- 10.37s
tensorflow : Remove TensorFlow git sources from previous build ---------- 3.63s
tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build --- 2.10s
Gathering Facts --------------------------------------------------------- 1.65s
tensorflow_in_container : (Python 3.8) build Python versioned container --- 1.46s
Create cache dirs ------------------------------------------------------- 1.38s
Cleanup after previous build -------------------------------------------- 1.28s
tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.24s
tensorflow : Save git commit hash to file ------------------------------- 1.15s
tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.87s
tensorflow_in_container : (Python 3.8) cleanup Bazel install directory --- 0.85s
tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.83s
tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.82s
tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.72s
tensorflow_in_container : (Python 3.8) create script to run tests ------- 0.72s
Build step 'Execute shell' marked build as failure
10 hours, 31 minutes
- 1
- 0
Build failed in Jenkins: Tensorflow oneDNN Python package (manylinux2014 nightly) #370
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/3…>
Changes:
------------------------------------------
[...truncated 67.23 MB...]
//tensorflow/compiler/tests:einsum_op_test_cpu_mlir_bridge_test PASSED in 6.9s
//tensorflow/compiler/tests:extract_image_patches_op_test_cpu PASSED in 6.3s
//tensorflow/compiler/tests:extract_image_patches_op_test_cpu_mlir_bridge_test PASSED in 7.9s
//tensorflow/compiler/tests:fake_quant_ops_test_cpu PASSED in 14.5s
//tensorflow/compiler/tests:gather_nd_op_test_cpu_mlir_bridge_test PASSED in 8.4s
//tensorflow/compiler/tests:gather_test_cpu PASSED in 31.7s
//tensorflow/compiler/tests:listdiff_op_test_cpu_mlir_bridge_test PASSED in 15.1s
//tensorflow/compiler/tests:manip_ops_test_cpu PASSED in 9.6s
//tensorflow/compiler/tests:matrix_inverse_op_test_cpu_mlir_bridge_test PASSED in 23.7s
//tensorflow/compiler/tests:nary_ops_test_cpu PASSED in 13.7s
//tensorflow/compiler/tests:nullary_ops_test_cpu PASSED in 9.1s
//tensorflow/compiler/tests:reduce_window_test_cpu PASSED in 8.1s
//tensorflow/compiler/tests:reverse_sequence_op_test_cpu PASSED in 8.2s
//tensorflow/compiler/tests:searchsorted_op_test_cpu PASSED in 7.7s
//tensorflow/compiler/tests:segment_reduction_ops_test_cpu_mlir_bridge_test PASSED in 32.1s
//tensorflow/compiler/tests:self_adjoint_eig_op_test_cpu PASSED in 17.0s
//tensorflow/compiler/tests:sparse_to_dense_op_test_cpu PASSED in 8.4s
//tensorflow/compiler/tests:tridiagonal_solve_ops_test_cpu PASSED in 17.4s
//tensorflow/compiler/tests:where_op_test_cpu PASSED in 12.0s
//tensorflow/compiler/xla:array4d_test PASSED in 0.2s
//tensorflow/compiler/xla:debug_options_parsers_test PASSED in 0.3s
//tensorflow/compiler/xla:layout_test PASSED in 0.2s
//tensorflow/compiler/xla:text_literal_reader_test PASSED in 0.2s
//tensorflow/compiler/xla/client:xla_builder_test PASSED in 0.3s
//tensorflow/compiler/xla/client/lib:arithmetic_test_cpu PASSED in 6.2s
//tensorflow/compiler/xla/client/lib:pooling_test_cpu PASSED in 6.9s
//tensorflow/compiler/xla/client/lib:qr_test_cpu PASSED in 10.9s
//tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:add_hlo_trace.mlir.test PASSED in 0.8s
//tensorflow/compiler/xla/mlir_hlo/tests:Dialect/deallocation/split_alloc_tensors.mlir.test PASSED in 0.7s
//tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/inline_fusion_clusters.mlir.test PASSED in 0.5s
//tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/reverse.mlir.test PASSED in 1.1s
//tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/constraint_fusion.mlir.test PASSED in 0.7s
//tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/convert_to_signless.mlir.test PASSED in 0.5s
//tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/expand_hlo_tuples.mlir.test PASSED in 0.5s
//tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-collapse-elementwise-map.mlir.test PASSED in 0.4s
//tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-arithmetic.mlir.test PASSED in 0.6s
//tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-stablehlo-experimental.mlir.test PASSED in 0.5s
//tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/lower-general-dot.mlir.test PASSED in 0.5s
//tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_bytecode_customizations.mlir.test PASSED in 0.7s
//tensorflow/compiler/xla/mlir_hlo/tests:Dialect/thlo/canonicalize.mlir.test PASSED in 0.5s
//tensorflow/compiler/xla/mlir_hlo/tests:Dialect/thlo/legalize_sort.mlir.test PASSED in 0.5s
//tensorflow/compiler/xla/pjrt:pjrt_api_test PASSED in 0.2s
//tensorflow/compiler/xla/pjrt:tracked_device_buffer_test PASSED in 9.6s
//tensorflow/compiler/xla/pjrt/distributed:client_server_test PASSED in 44.0s
//tensorflow/compiler/xla/python/ifrt:array_test PASSED in 0.2s
//tensorflow/compiler/xla/python/pjrt_ifrt:pjrt_client_impl_test_tfrt_cpu PASSED in 5.6s
//tensorflow/compiler/xla/python/pjrt_ifrt:pjrt_tuple_impl_test_tfrt_cpu PASSED in 5.9s
//tensorflow/compiler/xla/python_api:xla_shape_test PASSED in 0.9s
//tensorflow/compiler/xla/runtime:map_by_type_test PASSED in 0.2s
//tensorflow/compiler/xla/service:hlo_dataflow_analysis_test PASSED in 2.7s
//tensorflow/compiler/xla/service:hlo_element_type_converter_test PASSED in 0.8s
//tensorflow/compiler/xla/service:hlo_ordering_test PASSED in 0.8s
//tensorflow/compiler/xla/service:hlo_pass_pipeline_test PASSED in 0.8s
//tensorflow/compiler/xla/service:sharding_remover_test PASSED in 1.1s
//tensorflow/compiler/xla/service:while_loop_simplifier_test PASSED in 0.8s
//tensorflow/compiler/xla/service/gpu:hlo_fusion_stats_test PASSED in 0.9s
//tensorflow/compiler/xla/service/gpu:instruction_fusion_test PASSED in 1.3s
//tensorflow/compiler/xla/tests:all_reduce_test_cpu PASSED in 6.6s
//tensorflow/compiler/xla/tests:axpy_simple_test_cpu PASSED in 5.9s
//tensorflow/compiler/xla/tests:binop_scaling_test_cpu PASSED in 6.9s
//tensorflow/compiler/xla/tests:floor_ceil_test_cpu PASSED in 6.3s
//tensorflow/compiler/xla/tests:matrix_ops_simple_test_cpu PASSED in 12.2s
//tensorflow/compiler/xla/tests:multithreaded_compilation_test_cpu PASSED in 7.4s
//tensorflow/compiler/xla/tests:token_hlo_test_cpu PASSED in 6.7s
//tensorflow/compiler/xla/tests:tuple_test_cpu PASSED in 6.7s
//tensorflow/compiler/xla/tests:vector_ops_simple_test_cpu PASSED in 7.7s
//tensorflow/compiler/xla/tools:hlo_module_loader_test PASSED in 1.3s
//tensorflow/compiler/xla/tools/hlo_bisect:hlo_bisect_state_test PASSED in 1.4s
//tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:case_conditional.hlotxt.test PASSED in 0.6s
//tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:dynamic_param.hlo.test PASSED in 0.5s
//tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:entry_computation_layout.hlotxt.test PASSED in 0.7s
//tensorflow/core:__tensorflow_core_lib_strings_legacy_low_level_library_tests PASSED in 0.1s
//tensorflow/core:lib_strings_ordered_code_test PASSED in 1.2s
//tensorflow/core/common_runtime:cost_measurement_registry_test PASSED in 2.4s
//tensorflow/core/common_runtime:mkl_threadpool_device_test PASSED in 0.1s
//tensorflow/core/common_runtime:quantize_training_test PASSED in 1.8s
//tensorflow/core/data/service/snapshot:distributed_snapshot_test PASSED in 57.9s
//tensorflow/core/distributed_runtime/integration_test:c_api_multi_client_test_cpu PASSED in 25.5s
//tensorflow/core/distributed_runtime/integration_test:c_api_recoverable_jobs_test_cpu PASSED in 36.1s
//tensorflow/core/framework:kernel_def_builder_test PASSED in 0.9s
//tensorflow/core/framework:types_test PASSED in 0.7s
//tensorflow/core/function/capture:by_ref_capture_test PASSED in 46.3s
//tensorflow/core/function/polymorphism:function_type_test PASSED in 44.6s
//tensorflow/core/function/polymorphism:type_dispatch_test PASSED in 41.1s
//tensorflow/core/function/trace_type:default_types_test PASSED in 6.6s
//tensorflow/core/function/trace_type:serialization_test PASSED in 6.4s
//tensorflow/core/graph:collective_order_test PASSED in 0.5s
//tensorflow/core/graph:graph_def_builder_test PASSED in 1.0s
//tensorflow/core/grappler:graph_view_test PASSED in 2.2s
//tensorflow/core/grappler:mutable_graph_view_test PASSED in 1.7s
//tensorflow/core/grappler:utils_test PASSED in 2.5s
//tensorflow/core/grappler/costs:cost_estimator_test PASSED in 0.2s
//tensorflow/core/grappler/inputs:utils_test PASSED in 0.1s
//tensorflow/core/grappler/optimizers:function_api_info_test PASSED in 0.1s
//tensorflow/core/grappler/optimizers:generic_layout_optimizer_transposer_factory_test PASSED in 0.2s
//tensorflow/core/grappler/optimizers:graph_optimizer_stage_test_cpu PASSED in 2.5s
//tensorflow/core/grappler/optimizers:loop_optimizer_test_cpu PASSED in 1.9s
//tensorflow/core/grappler/optimizers:static_schedule_test_cpu PASSED in 1.5s
//tensorflow/core/grappler/optimizers:tfg_optimizer_hook_test PASSED in 0.5s
//tensorflow/core/grappler/optimizers/data:map_parallelization_test PASSED in 0.6s
//tensorflow/core/grappler/optimizers/data:replicate_on_split_test PASSED in 0.6s
//tensorflow/core/grappler/utils:canonicalizer_test PASSED in 1.3s
//tensorflow/core/grappler/utils:colocation_test PASSED in 0.5s
//tensorflow/core/grappler/utils:topological_sort_test PASSED in 0.5s
//tensorflow/core/grappler/utils:tpu_test PASSED in 0.2s
//tensorflow/core/ir:ops_test PASSED in 0.1s
//tensorflow/core/ir/importexport/tests/graphdef_to_mlir:empty.pbtxt.test PASSED in 1.6s
//tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_duplicated_node_name.pbtxt.test PASSED in 0.5s
//tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_generic_function_attr_name.pbtxt.test PASSED in 0.6s
//tensorflow/core/ir/importexport/tests/mlir_to_graphdef:three_nodes_with_attrs.mlir.test PASSED in 0.6s
//tensorflow/core/kernels:matmul_op_test_cpu PASSED in 2.9s
//tensorflow/core/kernels:mfcc_dct_test PASSED in 0.1s
//tensorflow/core/kernels:ops_util_test PASSED in 0.2s
//tensorflow/core/kernels:reduction_ops_test_cpu PASSED in 0.4s
//tensorflow/core/kernels:scatter_nd_op_test_cpu PASSED in 1.2s
//tensorflow/core/transforms:eval_utils_test PASSED in 1.4s
//tensorflow/dtensor/mlir/tests:function_renaming.mlir.test PASSED in 0.6s
//tensorflow/python/autograph/tests:type_annotations_test PASSED in 17.6s
//tensorflow/python/checkpoint:checkpoint_with_v1_optimizers_test PASSED in 20.1s
//tensorflow/python/checkpoint:restore_test PASSED in 12.3s
//tensorflow/python/checkpoint:save_util_v1_test PASSED in 10.5s
//tensorflow/python/client:device_lib_test_cpu PASSED in 16.1s
//tensorflow/python/grappler:arithmetic_optimizer_test_cpu PASSED in 13.4s
//tensorflow/python/kernel_tests/array_ops:constant_op_test_cpu PASSED in 8.7s
//tensorflow/python/kernel_tests/data_structures:stage_op_test_cpu PASSED in 12.1s
//tensorflow/python/kernel_tests/io_ops:record_input_test PASSED in 31.1s
//tensorflow/python/kernel_tests/linalg:determinant_op_test_cpu PASSED in 9.8s
//tensorflow/python/kernel_tests/linalg:matrix_solve_ls_op_test_cpu PASSED in 23.3s
//tensorflow/python/kernel_tests/random:random_grad_test_cpu PASSED in 7.3s
//tensorflow/python/kernel_tests/random:stateful_random_ops_test_cpu PASSED in 16.2s
//tensorflow/python/kernel_tests/signal:shape_ops_test_cpu PASSED in 22.0s
//tensorflow/python/kernel_tests/sparse_ops:sparse_tensors_map_ops_test PASSED in 7.3s
//tensorflow/python/kernel_tests/strings_ops:unicode_transcode_op_test PASSED in 6.8s
//tensorflow/python/ops/losses:util_test PASSED in 5.3s
//tensorflow/python/ops/numpy_ops/integration_test:np_config_test_cpu PASSED in 17.8s
//tensorflow/python/ops/ragged:ragged_bitcast_op_test PASSED in 8.1s
//tensorflow/python/ops/ragged:ragged_math_ops_test PASSED in 11.2s
//tensorflow/python/ops/ragged:ragged_print_op_test PASSED in 57.9s
//tensorflow/python/ops/ragged:ragged_reduce_op_test PASSED in 26.7s
//tensorflow/python/ops/ragged:ragged_row_lengths_op_test PASSED in 7.6s
//tensorflow/python/ops/ragged:ragged_util_test PASSED in 18.4s
//tensorflow/python/ops/structured:structured_tensor_test PASSED in 35.1s
//tensorflow/python/saved_model/model_utils:export_output_test PASSED in 9.4s
//tensorflow/python/summary/writer:writer_test PASSED in 30.6s
//tensorflow/python/tools:optimize_for_inference_test PASSED in 45.5s
//tensorflow/tsl/distributed_runtime/coordination:coordination_service_error_util_test PASSED in 0.8s
//tensorflow/tsl/framework:cancellation_test PASSED in 1.5s
//tensorflow/tsl/lib/gtl:tsl_lib_gtl_tests PASSED in 0.2s
//tensorflow/tsl/lib/random:distribution_sampler_test PASSED in 0.4s
//tensorflow/tsl/platform:float8_test PASSED in 0.7s
//tensorflow/tsl/platform:mutex_test PASSED in 0.4s
//tensorflow/tsl/platform:random_test PASSED in 1.9s
//tensorflow/tsl/platform:retrying_utils_test PASSED in 0.4s
//tensorflow/tsl/profiler/utils:parse_annotation_test PASSED in 0.4s
//tensorflow/compiler/tests:spacetobatch_op_test_cpu_mlir_bridge_test PASSED in 10.9s
Stats over 3 runs: max = 10.9s, min = 10.1s, avg = 10.4s, dev = 0.3s
//tensorflow/compiler/xla/tests:triangular_solve_test_cpu PASSED in 51.6s
Stats over 3 runs: max = 51.6s, min = 49.2s, avg = 50.4s, dev = 1.0s
//tensorflow/compiler/tests:unary_ops_test_cpu PASSED in 30.0s
Stats over 4 runs: max = 30.0s, min = 12.4s, avg = 21.9s, dev = 7.3s
//tensorflow/python/ops/ragged:ragged_getitem_test PASSED in 44.9s
Stats over 4 runs: max = 44.9s, min = 39.6s, avg = 42.3s, dev = 2.0s
//tensorflow/compiler/tests:depthwise_conv_op_test_cpu_mlir_bridge_test PASSED in 13.5s
Stats over 5 runs: max = 13.5s, min = 7.7s, avg = 10.4s, dev = 2.2s
//tensorflow/compiler/tests:repeat_op_test_cpu PASSED in 7.2s
Stats over 5 runs: max = 7.2s, min = 6.0s, avg = 6.3s, dev = 0.4s
//tensorflow/python/kernel_tests/linalg:cholesky_op_test_cpu PASSED in 74.9s
Stats over 5 runs: max = 74.9s, min = 32.9s, avg = 46.9s, dev = 14.9s
//tensorflow/compiler/tests:matrix_diag_ops_test_cpu PASSED in 51.4s
Stats over 8 runs: max = 51.4s, min = 3.0s, avg = 19.8s, dev = 16.0s
//tensorflow/compiler/tests:conv2d_test_cpu_mlir_bridge_test PASSED in 18.5s
Stats over 10 runs: max = 18.5s, min = 16.0s, avg = 17.3s, dev = 0.7s
//tensorflow/compiler/tests:stateless_random_ops_test_cpu_mlir_bridge_test PASSED in 65.3s
Stats over 10 runs: max = 65.3s, min = 31.0s, avg = 48.4s, dev = 11.7s
//tensorflow/python/kernel_tests/random:stateless_random_ops_test_cpu PASSED in 95.4s
Stats over 10 runs: max = 95.4s, min = 17.8s, avg = 53.5s, dev = 34.4s
//tensorflow/compiler/xla/service:triangular_solve_expander_test PASSED in 5.9s
Stats over 12 runs: max = 5.9s, min = 2.6s, avg = 3.7s, dev = 0.8s
//tensorflow/python/kernel_tests/signal:dct_ops_test_cpu PASSED in 10.3s
Stats over 16 runs: max = 10.3s, min = 5.7s, avg = 8.0s, dev = 1.7s
//tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 13.1s
Stats over 20 runs: max = 13.1s, min = 4.2s, avg = 7.4s, dev = 2.4s
//tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 10.3s
Stats over 20 runs: max = 10.3s, min = 2.5s, avg = 4.5s, dev = 2.0s
//tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 22.4s
Stats over 20 runs: max = 22.4s, min = 13.8s, avg = 18.2s, dev = 2.6s
//tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 97.0s
Stats over 20 runs: max = 97.0s, min = 25.1s, avg = 51.8s, dev = 19.8s
//tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 22.1s
Stats over 20 runs: max = 22.1s, min = 5.9s, avg = 14.0s, dev = 6.4s
//tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 27.7s
Stats over 30 runs: max = 27.7s, min = 2.8s, avg = 9.1s, dev = 6.2s
//tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 9.3s
Stats over 40 runs: max = 9.3s, min = 6.2s, avg = 7.2s, dev = 0.7s
//tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 93.0s
Stats over 50 runs: max = 93.0s, min = 18.7s, avg = 41.1s, dev = 25.1s
//tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 34.4s
Stats over 50 runs: max = 34.4s, min = 2.4s, avg = 9.1s, dev = 6.9s
Executed 348 out of 3632 tests: 348 tests pass, 2785 fail to build and 499 were skipped.
There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are.
stdout_lines: <omitted>
...ignoring
TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages] ***
Friday 17 March 2023 03:32:12 +0000 (0:43:02.932) 1:36:08.230 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) save list of installed Python packages] ***
Friday 17 March 2023 03:32:14 +0000 (0:00:01.882) 1:36:10.112 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) save tests output to file] ********
Friday 17 March 2023 03:32:15 +0000 (0:00:00.705) 1:36:10.818 **********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) save tests stderr output to file] ***
Friday 17 March 2023 03:32:15 +0000 (0:00:00.846) 1:36:11.664 **********
An exception occurred during task execution. To see the full traceback, use -vvv. The error was: OSError: [Errno 28] No space left on device
fatal: [localhost]: FAILED! =>
msg: Unexpected failure during module execution.
stdout: ''
PLAY RECAP *********************************************************************
localhost : ok=37 changed=28 unreachable=0 failed=1 skipped=8 rescued=0 ignored=1
Friday 17 March 2023 03:32:16 +0000 (0:00:00.351) 1:36:12.016 **********
===============================================================================
tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git 2905.00s
tensorflow_in_container : (Python 3.8) run TensorFlow-oneDNN-ACL git tests 2582.93s
tensorflow_in_container : (Python 3.8) build Python package ----------- 116.95s
tensorflow_in_container : (Python 3.8) start build container ---------- 116.61s
tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 21.43s
tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.68s
tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build --- 2.05s
tensorflow_in_container : (Python 3.8) collect list of installed Python packages --- 1.88s
Gathering Facts --------------------------------------------------------- 1.64s
tensorflow_in_container : (Python 3.8) build Python versioned container --- 1.59s
Create cache dirs ------------------------------------------------------- 1.38s
Cleanup after previous build -------------------------------------------- 1.28s
tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.25s
tensorflow : Save git commit hash to file ------------------------------- 1.11s
tensorflow_in_container : (Python 3.8) cleanup Bazel install directory --- 0.91s
tensorflow_in_container : (Python 3.8) save tests output to file -------- 0.85s
tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.84s
tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.81s
tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.79s
tensorflow : Create readme file about unit tests ------------------------ 0.74s
Build step 'Execute shell' marked build as failure
1 week, 1 day
- 1
- 1
Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #727
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/727/disp…>
Changes:
------------------------------------------
[...truncated 68.94 KB...]
/dt10/usr/bin/gcc @bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/service/cpu/ir_emission_utils_test-2.params)
# Configuration: b52fe58f1775b8e936e1eeafc4af662c6a41494ccccc6a033d1493e478ebef09
# Execution platform: @ml2014_aarch64_config_aarch64_platform//:platform
/usr/bin/ld: final link failed: No space left on device
collect2: error: ld returned 1 exit status
ERROR: /tf/tensorflow/tensorflow/compiler/xla/tests/BUILD:692:9: Linking tensorflow/compiler/xla/tests/unary_op_test_cpu failed: (Exit 1): gcc failed: error executing command
(cd /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow && \
exec env - \
CACHEBUSTER=20220325 \
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin \
PWD=/proc/self/cwd \
PYTHON_BIN_PATH=/usr/local/bin/python3 \
TF2_BEHAVIOR=1 \
/dt10/usr/bin/gcc @bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/tests/unary_op_test_cpu-2.params)
# Configuration: b52fe58f1775b8e936e1eeafc4af662c6a41494ccccc6a033d1493e478ebef09
# Execution platform: @ml2014_aarch64_config_aarch64_platform//:platform
/usr/bin/ld: final link failed: No space left on device
collect2: error: ld returned 1 exit status
ERROR: /tf/tensorflow/tensorflow/compiler/xla/tests/BUILD:2785:12: Compiling tensorflow/compiler/xla/tests/multiple_devices_on_host_test.cc failed: (Exit 1): gcc failed: error executing command
(cd /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow && \
exec env - \
CACHEBUSTER=20220325 \
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin \
PWD=/proc/self/cwd \
PYTHON_BIN_PATH=/usr/local/bin/python3 \
TF2_BEHAVIOR=1 \
/dt10/usr/bin/gcc -MD -MF bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/tests/_objs/multiple_devices_on_host_test/multiple_devices_on_host_test.d '-frandom-seed=bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/tests/_objs/multiple_devices_on_host_test/multiple_devices_on_host_test.o' -DEIGEN_MPL2_ONLY '-DEIGEN_MAX_ALIGN_BYTES=64' -DBENCHMARK_STATIC_DEFINE -DHAVE_SYS_UIO_H -DTF_USE_SNAPPY '-DGRPC_ARES=0' '-DLLVM_ON_UNIX=1' '-DHAVE_BACKTRACE=1' '-DBACKTRACE_HEADER=<execinfo.h>' '-DLTDL_SHLIB_EXT=".so"' '-DLLVM_PLUGIN_EXT=".so"' '-DLLVM_ENABLE_THREADS=1' '-DHAVE_DEREGISTER_FRAME=1' '-DHAVE_LIBPTHREAD=1' '-DHAVE_PTHREAD_GETNAME_NP=1' '-DHAVE_PTHREAD_H=1' '-DHAVE_PTHREAD_SETNAME_NP=1' '-DHAVE_REGISTER_FRAME=1' '-DHAVE_SETENV_R=1' '-DHAVE_STRERROR_R=1' '-DHAVE_SYSEXITS_H=1' '-DHAVE_UNISTD_H=1' -D_GNU_SOURCE '-DHAVE_LINK_H=1' '-DHAVE_LSEEK64=1' '-DHAVE_MALLINFO=1' '-DHAVE_SBRK=1' '-DHAVE_STRUCT_STAT_ST_MTIM_TV_NSEC=1' '-DLLVM_NATIVE_ARCH="AArch64"' '-DLLVM_NATIVE_ASMPARSER=LLVMInitializeAArch64AsmParser' '-DLLVM_NATIVE_ASMPRINTER=LLVMInitializeAArch64AsmPrinter' '-DLLVM_NATIVE_DISASSEMBLER=LLVMInitializeAArch64Disassembler' '-DLLVM_NATIVE_TARGET=LLVMInitializeAArch64Target' '-DLLVM_NATIVE_TARGETINFO=LLVMInitializeAArch64TargetInfo' '-DLLVM_NATIVE_TARGETMC=LLVMInitializeAArch64TargetMC' '-DLLVM_NATIVE_TARGETMCA=LLVMInitializeAArch64TargetMCA' '-DLLVM_HOST_TRIPLE="aarch64-unknown-linux-gnu"' '-DLLVM_DEFAULT_TARGET_TRIPLE="aarch64-unknown-linux-gnu"' '-DLLVM_VERSION_MAJOR=17' '-DLLVM_VERSION_MINOR=0' '-DLLVM_VERSION_PATCH=0' '-DLLVM_VERSION_STRING="17.0.0git"' -D__STDC_LIMIT_MACROS -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS '-DBLAKE3_USE_NEON=0' -DBLAKE3_NO_AVX2 -DBLAKE3_NO_AVX512 -DBLAKE3_NO_SSE2 -DBLAKE3_NO_SSE41 -DTENSORFLOW_USE_CUSTOM_CONTRACTION_KERNEL -DGEMM_KERNEL_H '-DEIGEN_ALTIVEC_USE_CUSTOM_PACK=0' '-DEIGEN_NEON_GEBP_NR=4' -iquote . -iquote bazel-out/aarch64-opt/bin -iquote external/eigen_archive -iquote bazel-out/aarch64-opt/bin/external/eigen_archive -iquote external/com_google_absl -iquote bazel-out/aarch64-opt/bin/external/com_google_absl -iquote external/nsync -iquote bazel-out/aarch64-opt/bin/external/nsync -iquote external/com_google_protobuf -iquote bazel-out/aarch64-opt/bin/external/com_google_protobuf -iquote external/double_conversion -iquote bazel-out/aarch64-opt/bin/external/double_conversion -iquote external/com_google_googletest -iquote bazel-out/aarch64-opt/bin/external/com_google_googletest -iquote external/com_google_benchmark -iquote bazel-out/aarch64-opt/bin/external/com_google_benchmark -iquote external/snappy -iquote bazel-out/aarch64-opt/bin/external/snappy -iquote external/com_googlesource_code_re2 -iquote bazel-out/aarch64-opt/bin/external/com_googlesource_code_re2 -iquote external/com_github_grpc_grpc -iquote bazel-out/aarch64-opt/bin/external/com_github_grpc_grpc -iquote external/zlib -iquote bazel-out/aarch64-opt/bin/external/zlib -iquote external/upb -iquote bazel-out/aarch64-opt/bin/external/upb -iquote external/boringssl -iquote bazel-out/aarch64-opt/bin/external/boringssl -iquote external/farmhash_archive -iquote bazel-out/aarch64-opt/bin/external/farmhash_archive -iquote external/llvm-project -iquote bazel-out/aarch64-opt/bin/external/llvm-project -iquote external/llvm_terminfo -iquote bazel-out/aarch64-opt/bin/external/llvm_terminfo -iquote external/llvm_zlib -iquote bazel-out/aarch64-opt/bin/external/llvm_zlib -iquote external/tf_runtime -iquote bazel-out/aarch64-opt/bin/external/tf_runtime -iquote external/stablehlo -iquote bazel-out/aarch64-opt/bin/external/stablehlo -iquote external/bazel_tools -iquote bazel-out/aarch64-opt/bin/external/bazel_tools -Ibazel-out/aarch64-opt/bin/external/com_google_benchmark/_virtual_includes/benchmark -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BuiltinAttributeInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BuiltinAttributesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BuiltinDialectIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BuiltinLocationAttributesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BuiltinOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BuiltinTypeInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BuiltinTypesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/CallOpInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/CastOpInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/FunctionInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/InferTypeOpInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/OpAsmInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/RegionKindInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/SideEffectInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/SymbolInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TensorEncodingIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ArithBaseIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ArithCanonicalizationIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ArithOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ArithOpsInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/InferIntRangeInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/VectorInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ControlFlowInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LoopLikeInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/AsmParserTokenKinds -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/DialectUtilsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ViewLikeInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/PDLOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/PDLTypesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/PDLInterpOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ConversionPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/RuntimeVerifiableOpInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TransformsPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/InstCombineTableGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/JITLinkTableGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ControlFlowOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/FuncIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/AsyncOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/X86CodeGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/X86CommonTableGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/X86Info -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/X86UtilsAndDesc -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/AArch64CodeGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/AArch64CommonTableGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/AArch64Info -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/AArch64UtilsAndDesc -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LLVMDialectInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LLVMIntrinsicOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LLVMOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LLVMTypesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/MathBaseIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/MathOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/CopyOpInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/MemRefBaseIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/MemRefOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ShapedOpInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/AffineMemoryOpInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/AffineOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/AllocationOpInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BufferizableOpInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BufferizationBaseIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BufferizationEnumsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BufferizationOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/DestinationStyleOpInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/SparseTensorAttrDefsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/SparseTensorOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/SparseTensorTypesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ComplexAttributesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ComplexBaseIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ComplexOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ParallelCombiningOpInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TensorOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TilingInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BufferizationPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/FuncTransformsPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/SCFDeviceMappingInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/SCFIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/SCFPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/DLTIBaseIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LLVMConversionIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LLVMPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/NVVMOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LLVMIntrinsicConversionIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/OpenMPInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/OpenMPOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/OpenMPTypeInterfacesIncGen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/mlir_hlo -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/canonicalize_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/convert_op_folder -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/hlo_ops_attrs_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/hlo_ops_common -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/hlo_ops_enums_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/hlo_ops_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/hlo_ops_pattern_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/hlo_ops_typedefs_inc_gen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/QuantOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/MLIRShapeCanonicalizationIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ShapeOpsIncGen -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/base -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/base_attr_interfaces_inc_gen -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/broadcast_utils -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/chlo_ops -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/chlo_attrs_inc_gen -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/chlo_enums_inc_gen -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/chlo_ops_inc_gen -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/stablehlo_assembly_format -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/stablehlo_type_inference -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/lhlo -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/lhlo_ops_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/lhlo_ops_structs_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/lhlo_structured_interface -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/lhlo_structured_interface_inc_gen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/MaskableOpInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/MaskingOpInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/VectorOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ArithPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/GPUBaseIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/GPUOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LinalgEnumsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LinalgInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LinalgOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LinalgStructuredOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LinalgPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/MemRefPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TensorPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/VectorEnumsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/VectorPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/X86VectorIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/AMXIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ArmNeonIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ArmSVEIncGen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/all_passes -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/chlo_legalize_to_hlo -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/chlo_legalize_to_hlo_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/map_chlo_to_hlo_op -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/deallocation_passes -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/deallocation -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/deallocation_ops_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/deallocation_utils -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/deallocation_passes_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/gml_st_passes -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/gml_st -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/gml_st_ops_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/gml_st_passes_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/gml_st_transforms -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/thlo -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/thlo_ops_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/type_conversion -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/stablehlo_ops -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/stablehlo_attrs_inc_gen -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/stablehlo_enums_inc_gen -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/stablehlo_ops_inc_gen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ShapeTransformsPassIncGen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/lmhlo_pass_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/lmhlo_passes -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/map_lmhlo_to_scalar_op -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/map_lhlo_to_hlo_op -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/map_mhlo_to_scalar_op -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/mhlo_pass_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/mhlo_passes -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/hlo_legalize_to_stablehlo -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/map_stablehlo_to_hlo_op -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/legalize_to_linalg_utils -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/legalize_to_standard_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/lower_complex_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/map_hlo_to_lhlo_op -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/mhlo_rng_utils -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/mhlo_scatter_gather_utils -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/shape_component_analysis -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/stablehlo_legalize_to_hlo -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/thlo_bufferizable_op_interface -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/unfuse_batch_norm -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/thlo_passes -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/thlo_passes_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/transforms_passes -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/transforms_passes_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/userange_analysis -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TransformDialectEnumsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TransformDialectIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TransformDialectInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TransformOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TransformTypesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TransformDialectTransformsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ShapeToStandardGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/SparseTensorPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/AMXConversionIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ArmNeonConversionIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ArmSVEConversionIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/AsyncPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/X86VectorConversionIncGen -isystem external/eigen_archive -isystem bazel-out/aarch64-opt/bin/external/eigen_archive -isystem external/nsync/public -isystem bazel-out/aarch64-opt/bin/external/nsync/public -isystem external/com_google_protobuf/src -isystem bazel-out/aarch64-opt/bin/external/com_google_protobuf/src -isystem external/com_google_googletest/googlemock -isystem bazel-out/aarch64-opt/bin/external/com_google_googletest/googlemock -isystem external/com_google_googletest/googlemock/include -isystem bazel-out/aarch64-opt/bin/external/com_google_googletest/googlemock/include -isystem external/com_google_googletest/googletest -isystem bazel-out/aarch64-opt/bin/external/com_google_googletest/googletest -isystem external/com_google_googletest/googletest/include -isystem bazel-out/aarch64-opt/bin/external/com_google_googletest/googletest/include -isystem external/com_github_grpc_grpc/include -isystem bazel-out/aarch64-opt/bin/external/com_github_grpc_grpc/include -isystem external/com_github_grpc_grpc/src/core/ext/upb-generated -isystem bazel-out/aarch64-opt/bin/external/com_github_grpc_grpc/src/core/ext/upb-generated -isystem external/zlib -isystem bazel-out/aarch64-opt/bin/external/zlib -isystem external/com_github_grpc_grpc/third_party/address_sorting/include -isystem bazel-out/aarch64-opt/bin/external/com_github_grpc_grpc/third_party/address_sorting/include -isystem external/boringssl/src/include -isystem bazel-out/aarch64-opt/bin/external/boringssl/src/include -isystem external/farmhash_archive/src -isystem bazel-out/aarch64-opt/bin/external/farmhash_archive/src -isystem external/llvm-project/llvm/include -isystem bazel-out/aarch64-opt/bin/external/llvm-project/llvm/include -isystem external/llvm-project/mlir/include -isystem bazel-out/aarch64-opt/bin/external/llvm-project/mlir/include -isystem external/tf_runtime/include -isystem bazel-out/aarch64-opt/bin/external/tf_runtime/include -isystem external/tf_runtime/third_party/llvm_derived/include -isystem bazel-out/aarch64-opt/bin/external/tf_runtime/third_party/llvm_derived/include -isystem external/llvm-project/llvm/lib/Target/X86 -isystem bazel-out/aarch64-opt/bin/external/llvm-project/llvm/lib/Target/X86 -isystem external/llvm-project/llvm/lib/Target/AArch64 -isystem bazel-out/aarch64-opt/bin/external/llvm-project/llvm/lib/Target/AArch64 -isystem tensorflow/compiler/xla/translate/hlo_to_mhlo/include -isystem bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/translate/hlo_to_mhlo/include -isystem external/llvm-project/mlir/lib/Conversion/TensorToLinalg -isystem bazel-out/aarch64-opt/bin/external/llvm-project/mlir/lib/Conversion/TensorToLinalg -Wno-builtin-macro-redefined '-D__DATE__="redacted"' '-D__TIMESTAMP__="redacted"' '-D__TIME__="redacted"' -fPIE -U_FORTIFY_SOURCE '-D_FORTIFY_SOURCE=1' -fstack-protector -Wall -fno-omit-frame-pointer -no-canonical-prefixes -fno-canonical-system-headers -DNDEBUG -g0 -O2 -ffunction-sections -fdata-sections -Wno-all -Wno-extra -Wno-deprecated -Wno-deprecated-declarations -Wno-ignored-attributes -Wno-array-bounds -Wunused-result '-Werror=unused-result' -Wswitch '-Werror=switch' '-Wno-error=unused-but-set-variable' -DAUTOLOAD_DYNAMIC_KERNELS '-mtune=generic' '-march=armv8-a' -O3 '-std=c++17' '--sysroot=/dt10' -c tensorflow/compiler/xla/tests/multiple_devices_on_host_test.cc -o bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/tests/_objs/multiple_devices_on_host_test/multiple_devices_on_host_test.o)
# Configuration: b52fe58f1775b8e936e1eeafc4af662c6a41494ccccc6a033d1493e478ebef09
# Execution platform: @ml2014_aarch64_config_aarch64_platform//:platform
ERROR: /tf/tensorflow/tensorflow/core/distributed_runtime/rpc/BUILD:398:13: Linking tensorflow/core/distributed_runtime/rpc/grpc_testlib_server failed: (Exit 1): gcc failed: error executing command
(cd /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow && \
exec env - \
CACHEBUSTER=20220325 \
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin \
PWD=/proc/self/cwd \
PYTHON_BIN_PATH=/usr/local/bin/python3 \
TF2_BEHAVIOR=1 \
/dt10/usr/bin/gcc @bazel-out/aarch64-opt/bin/tensorflow/core/distributed_runtime/rpc/grpc_testlib_server-2.params)
# Configuration: b52fe58f1775b8e936e1eeafc4af662c6a41494ccccc6a033d1493e478ebef09
# Execution platform: @ml2014_aarch64_config_aarch64_platform//:platform
No space left on device
collect2: error: ld returned 1 exit status
ERROR: /tf/tensorflow/tensorflow/compiler/xla/service/BUILD:3159:12: Linking tensorflow/compiler/xla/service/while_loop_simplifier_test failed: (Exit 1): gcc failed: error executing command
(cd /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow && \
exec env - \
CACHEBUSTER=20220325 \
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin \
PWD=/proc/self/cwd \
PYTHON_BIN_PATH=/usr/local/bin/python3 \
TF2_BEHAVIOR=1 \
/dt10/usr/bin/gcc @bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/service/while_loop_simplifier_test-2.params)
# Configuration: b52fe58f1775b8e936e1eeafc4af662c6a41494ccccc6a033d1493e478ebef09
# Execution platform: @ml2014_aarch64_config_aarch64_platform//:platform
: final link failed: No space left on device
collect2: error: ld returned 1 exit status
ERROR: /tf/tensorflow/tensorflow/compiler/xla/service/BUILD:4574:12: Linking tensorflow/compiler/xla/service/memory_space_assignment_best_fit_repacker_test failed: Exec failed due to IOException: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/local-spawn-runner.3667359627142337217: No space left on device
ERROR: /tf/tensorflow/tensorflow/compiler/xla/mlir_hlo/tests/BUILD:11:13: Creating source manifest for //tensorflow/compiler/xla/mlir_hlo/tests:rank-specialization.mlir.test failed: unexpected I/O exception: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/tests/rank-specialization.mlir.test.runfiles_manifest (No space left on device)
ERROR: /tf/tensorflow/tensorflow/compiler/xla/service/cpu/BUILD:1451:12: Linking tensorflow/compiler/xla/service/cpu/cpu_eigen_tensor_alignment_test failed: (Exit 1): gcc failed: error executing command
(cd /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow && \
exec env - \
CACHEBUSTER=20220325 \
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin \
PWD=/proc/self/cwd \
PYTHON_BIN_PATH=/usr/local/bin/python3 \
TF2_BEHAVIOR=1 \
/dt10/usr/bin/gcc @bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/service/cpu/cpu_eigen_tensor_alignment_test-2.params)
# Configuration: b52fe58f1775b8e936e1eeafc4af662c6a41494ccccc6a033d1493e478ebef09
# Execution platform: @ml2014_aarch64_config_aarch64_platform//:platform
/usr/bin/ld: final link failed: No space left on device
collect2: error: ld returned 1 exit status
ERROR: /tf/tensorflow/tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir/BUILD:8:15: Expanding template tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir/arg-data-type.pbtxt.test failed: unexpected I/O exception: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir/arg-data-type.pbtxt.test (No space left on device)
ERROR: /tf/tensorflow/tensorflow/compiler/xla/service/BUILD:5631:12: Writing file tensorflow/compiler/xla/service/tuple_util_test-2.params failed: unexpected I/O exception: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/service/tuple_util_test-2.params (No space left on device)
ERROR: /tf/tensorflow/tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir/BUILD:8:15: Creating source manifest for //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:arg-data-type.pbtxt.test failed: unexpected I/O exception: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir/arg-data-type.pbtxt.test.runfiles_manifest (No space left on device)
ERROR: /tf/tensorflow/tensorflow/compiler/xla/service/BUILD:5631:12: Creating source manifest for //tensorflow/compiler/xla/service:tuple_util_test failed: unexpected I/O exception: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/service/tuple_util_test.runfiles_manifest (No space left on device)
ERROR: /tf/tensorflow/tensorflow/compiler/xla/service/cpu/BUILD:1284:12: Linking tensorflow/compiler/xla/service/cpu/cpu_layout_assignment_test failed: (Exit 1): gcc failed: error executing command
(cd /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow && \
exec env - \
CACHEBUSTER=20220325 \
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin \
PWD=/proc/self/cwd \
PYTHON_BIN_PATH=/usr/local/bin/python3 \
TF2_BEHAVIOR=1 \
/dt10/usr/bin/gcc @bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/service/cpu/cpu_layout_assignment_test-2.params)
# Configuration: b52fe58f1775b8e936e1eeafc4af662c6a41494ccccc6a033d1493e478ebef09
# Execution platform: @ml2014_aarch64_config_aarch64_platform//:platform
/usr/bin/ld: final link failed: No space left on device
collect2: error: ld returned 1 exit status
WARNING: Remote Cache: /tf/cache/0cab8640-2d02-43ac-90d1-2f1c8100c979 (No space left on device)
com.google.devtools.build.lib.remote.common.BulkTransferException: /tf/cache/0cab8640-2d02-43ac-90d1-2f1c8100c979 (No space left on device)
at com.google.devtools.build.lib.remote.util.RxUtils$BulkTransferExceptionCollector.onResult(RxUtils.java:91)
at io.reactivex.rxjava3.internal.operators.flowable.FlowableCollectSingle$CollectSubscriber.onNext(FlowableCollectSingle.java:94)
at io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMapSingle$FlatMapSingleSubscriber.innerSuccess(FlowableFlatMapSingle.java:173)
at io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMapSingle$FlatMapSingleSubscriber$InnerObserver.onSuccess(FlowableFlatMapSingle.java:342)
at io.reactivex.rxjava3.internal.operators.single.SingleDoFinally$DoFinallyObserver.onSuccess(SingleDoFinally.java:73)
at io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46)
at io.reactivex.rxjava3.internal.operators.single.SingleJust.subscribeActual(SingleJust.java:30)
at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855)
at io.reactivex.rxjava3.internal.operators.single.SingleResumeNext$ResumeMainSingleObserver.onError(SingleResumeNext.java:80)
at io.reactivex.rxjava3.internal.operators.completable.CompletableToSingle$ToSingle.onError(CompletableToSingle.java:73)
at io.reactivex.rxjava3.internal.operators.completable.CompletableCreate$Emitter.tryOnError(CompletableCreate.java:91)
at io.reactivex.rxjava3.internal.operators.completable.CompletableCreate$Emitter.onError(CompletableCreate.java:77)
at com.google.devtools.build.lib.remote.util.RxFutures$OnceCompletableOnSubscribe$1.onFailure(RxFutures.java:102)
at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1074)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213)
at com.google.common.util.concurrent.AbstractFuture.addListener(AbstractFuture.java:724)
at com.google.common.util.concurrent.Futures.addCallback(Futures.java:1047)
at com.google.devtools.build.lib.remote.util.RxFutures$OnceCompletableOnSubscribe.subscribe(RxFutures.java:80)
at io.reactivex.rxjava3.internal.operators.completable.CompletableCreate.subscribeActual(CompletableCreate.java:40)
at io.reactivex.rxjava3.core.Completable.subscribe(Completable.java:2859)
at io.reactivex.rxjava3.internal.operators.completable.CompletableToSingle.subscribeActual(CompletableToSingle.java:37)
at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855)
at io.reactivex.rxjava3.internal.operators.single.SingleResumeNext.subscribeActual(SingleResumeNext.java:39)
at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855)
at io.reactivex.rxjava3.internal.operators.single.SingleDoFinally.subscribeActual(SingleDoFinally.java:44)
at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855)
at io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMapSingle$FlatMapSingleSubscriber.onNext(FlowableFlatMapSingle.java:131)
at io.reactivex.rxjava3.internal.operators.single.SingleFlatMapPublisher$SingleFlatMapPublisherObserver.onNext(SingleFlatMapPublisher.java:107)
at io.reactivex.rxjava3.internal.operators.flowable.FlowableFromIterable$IteratorSubscription.fastPath(FlowableFromIterable.java:185)
at io.reactivex.rxjava3.internal.operators.flowable.FlowableFromIterable$BaseRangeSubscription.request(FlowableFromIterable.java:129)
at io.reactivex.rxjava3.internal.subscriptions.SubscriptionHelper.deferredSetOnce(SubscriptionHelper.java:202)
at io.reactivex.rxjava3.internal.operators.single.SingleFlatMapPublisher$SingleFlatMapPublisherObserver.onSubscribe(SingleFlatMapPublisher.java:102)
at io.reactivex.rxjava3.internal.operators.flowable.FlowableFromIterable.subscribe(FlowableFromIterable.java:69)
at io.reactivex.rxjava3.internal.operators.flowable.FlowableFromIterable.subscribeActual(FlowableFromIterable.java:47)
at io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15917)
at io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15863)
at io.reactivex.rxjava3.internal.operators.single.SingleFlatMapPublisher$SingleFlatMapPublisherObserver.onSuccess(SingleFlatMapPublisher.java:96)
at io.reactivex.rxjava3.internal.operators.single.SingleDoOnSuccess$DoOnSuccess.onSuccess(SingleDoOnSuccess.java:60)
at io.reactivex.rxjava3.internal.operators.single.SingleDoOnDispose$DoOnDisposeObserver.onSuccess(SingleDoOnDispose.java:84)
at io.reactivex.rxjava3.internal.operators.single.SingleDoOnError$DoOnError.onSuccess(SingleDoOnError.java:52)
at io.reactivex.rxjava3.internal.operators.single.SingleDoOnSubscribe$DoOnSubscribeSingleObserver.onSuccess(SingleDoOnSubscribe.java:77)
at io.reactivex.rxjava3.internal.operators.single.SingleCreate$Emitter.onSuccess(SingleCreate.java:68)
at com.google.devtools.build.lib.remote.util.RxFutures$OnceSingleOnSubscribe$1.onSuccess(RxFutures.java:155)
at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.ImmediateFuture.addListener(ImmediateFuture.java:47)
at com.google.common.util.concurrent.Futures.addCallback(Futures.java:1047)
at com.google.devtools.build.lib.remote.util.RxFutures$OnceSingleOnSubscribe.subscribe(RxFutures.java:150)
at io.reactivex.rxjava3.internal.operators.single.SingleCreate.subscribeActual(SingleCreate.java:40)
at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855)
at io.reactivex.rxjava3.internal.operators.single.SingleDoOnSubscribe.subscribeActual(SingleDoOnSubscribe.java:41)
at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855)
at io.reactivex.rxjava3.internal.operators.single.SingleDoOnError.subscribeActual(SingleDoOnError.java:35)
at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855)
at io.reactivex.rxjava3.internal.operators.single.SingleDoOnDispose.subscribeActual(SingleDoOnDispose.java:38)
at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855)
at io.reactivex.rxjava3.internal.operators.single.SingleDoOnSuccess.subscribeActual(SingleDoOnSuccess.java:35)
at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855)
at io.reactivex.rxjava3.internal.operators.single.SingleFlatMapPublisher.subscribeActual(SingleFlatMapPublisher.java:59)
at io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15917)
at io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMapSingle.subscribeActual(FlowableFlatMapSingle.java:53)
at io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15917)
at io.reactivex.rxjava3.internal.operators.flowable.FlowableCollectSingle.subscribeActual(FlowableCollectSingle.java:53)
at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855)
at io.reactivex.rxjava3.internal.operators.single.SingleFlatMapCompletable.subscribeActual(SingleFlatMapCompletable.java:44)
at io.reactivex.rxjava3.core.Completable.subscribe(Completable.java:2859)
at io.reactivex.rxjava3.internal.operators.completable.CompletableConcatArray$ConcatInnerObserver.next(CompletableConcatArray.java:89)
at io.reactivex.rxjava3.internal.operators.completable.CompletableConcatArray.subscribeActual(CompletableConcatArray.java:33)
at io.reactivex.rxjava3.core.Completable.subscribe(Completable.java:2859)
at io.reactivex.rxjava3.internal.operators.completable.CompletableToSingle.subscribeActual(CompletableToSingle.java:37)
at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855)
at io.reactivex.rxjava3.core.Single.blockingGet(Single.java:3644)
at com.google.devtools.build.lib.remote.UploadManifest.upload(UploadManifest.java:355)
at com.google.devtools.build.lib.remote.RemoteExecutionService.uploadOutputs(RemoteExecutionService.java:1317)
at com.google.devtools.build.lib.remote.RemoteSpawnCache$1.store(RemoteSpawnCache.java:194)
at com.google.devtools.build.lib.exec.AbstractSpawnStrategy.exec(AbstractSpawnStrategy.java:151)
at com.google.devtools.build.lib.exec.AbstractSpawnStrategy.exec(AbstractSpawnStrategy.java:108)
at com.google.devtools.build.lib.actions.SpawnStrategy.beginExecution(SpawnStrategy.java:47)
at com.google.devtools.build.lib.exec.SpawnStrategyResolver.beginExecution(SpawnStrategyResolver.java:68)
at com.google.devtools.build.lib.rules.cpp.CppLinkAction.beginExecution(CppLinkAction.java:286)
at com.google.devtools.build.lib.actions.Action.execute(Action.java:133)
at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor$5.execute(SkyframeActionExecutor.java:907)
at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor$ActionRunner.continueAction(SkyframeActionExecutor.java:1076)
at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor$ActionRunner.run(SkyframeActionExecutor.java:1031)
at com.google.devtools.build.lib.skyframe.ActionExecutionState.runStateMachine(ActionExecutionState.java:152)
at com.google.devtools.build.lib.skyframe.ActionExecutionState.getResultOrDependOnFuture(ActionExecutionState.java:91)
at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor.executeAction(SkyframeActionExecutor.java:492)
at com.google.devtools.build.lib.skyframe.ActionExecutionFunction.checkCacheAndExecuteIfNeeded(ActionExecutionFunction.java:856)
at com.google.devtools.build.lib.skyframe.ActionExecutionFunction.computeInternal(ActionExecutionFunction.java:349)
at com.google.devtools.build.lib.skyframe.ActionExecutionFunction.compute(ActionExecutionFunction.java:169)
at com.google.devtools.build.skyframe.AbstractParallelEvaluator$Evaluate.run(AbstractParallelEvaluator.java:590)
at com.google.devtools.build.lib.concurrent.AbstractQueueVisitor$WrappedRunnable.run(AbstractQueueVisitor.java:382)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Suppressed: java.io.IOException: /tf/cache/0cab8640-2d02-43ac-90d1-2f1c8100c979 (No space left on device)
at com.google.devtools.build.lib.unix.NativePosixFiles.openWrite(Native Method)
at com.google.devtools.build.lib.unix.UnixFileSystem.createFileOutputStream(UnixFileSystem.java:493)
at com.google.devtools.build.lib.vfs.AbstractFileSystem.getOutputStream(AbstractFileSystem.java:174)
at com.google.devtools.build.lib.vfs.AbstractFileSystem.getOutputStream(AbstractFileSystem.java:188)
at com.google.devtools.build.lib.vfs.Path.getOutputStream(Path.java:425)
at com.google.devtools.build.lib.vfs.Path.getOutputStream(Path.java:413)
at com.google.devtools.build.lib.remote.disk.DiskCacheClient.saveFile(DiskCacheClient.java:177)
at com.google.devtools.build.lib.remote.disk.DiskCacheClient.uploadBlob(DiskCacheClient.java:143)
at com.google.devtools.build.lib.remote.RemoteCache.lambda$uploadBlob$2(RemoteCache.java:174)
at com.google.devtools.build.lib.remote.util.RxFutures$OnceCompletableOnSubscribe.subscribe(RxFutures.java:79)
at io.reactivex.rxjava3.internal.operators.completable.CompletableCreate.subscribeActual(CompletableCreate.java:40)
at io.reactivex.rxjava3.core.Completable.subscribe(Completable.java:2859)
at io.reactivex.rxjava3.internal.operators.completable.CompletableToSingle.subscribeActual(CompletableToSingle.java:37)
at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855)
at com.google.devtools.build.lib.remote.util.AsyncTaskCache$Execution.subscribeActual(AsyncTaskCache.java:157)
at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855)
at com.google.devtools.build.lib.remote.util.AsyncTaskCache.lambda$execute$2(AsyncTaskCache.java:315)
at io.reactivex.rxjava3.internal.operators.single.SingleCreate.subscribeActual(SingleCreate.java:40)
at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855)
at io.reactivex.rxjava3.internal.operators.completable.CompletableFromSingle.subscribeActual(CompletableFromSingle.java:29)
at io.reactivex.rxjava3.core.Completable.subscribe(Completable.java:2859)
at com.google.devtools.build.lib.remote.util.RxFutures.toListenableFuture(RxFutures.java:195)
at com.google.devtools.build.lib.remote.RemoteCache.uploadBlob(RemoteCache.java:176)
at com.google.devtools.build.lib.remote.UploadManifest.lambda$upload$1(UploadManifest.java:380)
at com.google.devtools.build.lib.remote.util.RxFutures$OnceCompletableOnSubscribe.subscribe(RxFutures.java:79)
... 77 more
java.util.logging.ErrorManager: 1
stderr_lines: <omitted>
stdout: ''
stdout_lines: <omitted>
...ignoring
TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages] ***
Friday 17 March 2023 01:56:54 +0000 (6:20:07.557) 7:46:45.554 **********
fatal: [localhost]: FAILED! => changed=false
msg: 'The container "tf-py3.8" has been paused (409 Client Error for http+docker://localhost/v1.41/containers/tf-py3.8/exec: Conflict ("Container 9992ab147b31777ef2df8d716da0829ada3582fb3cd144595d90af81e7061a10 is not running"))'
PLAY RECAP *********************************************************************
localhost : ok=34 changed=25 unreachable=0 failed=1 skipped=8 rescued=0 ignored=1
Friday 17 March 2023 01:56:59 +0000 (0:00:04.602) 7:46:50.157 **********
===============================================================================
tensorflow_in_container : (Python 3.8) run TensorFlow git tests ------ 22807.56s
tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 4966.68s
tensorflow_in_container : (Python 3.8) build Python package ----------- 153.31s
tensorflow : Fetch TensorFlow from git --------------------------------- 28.75s
tensorflow_in_container : (Python 3.8) start build container ------------ 7.82s
tensorflow : Remove TensorFlow git sources from previous build ---------- 7.06s
tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build --- 4.63s
tensorflow_in_container : (Python 3.8) collect list of installed Python packages --- 4.60s
tensorflow_in_container : (Python 3.8) build Python versioned container --- 2.83s
tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 2.38s
tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 2.20s
Gathering Facts --------------------------------------------------------- 2.15s
Create cache dirs ------------------------------------------------------- 1.81s
tensorflow_in_container : (Python 3.8) create link for pip cache -------- 1.77s
tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 1.77s
Cleanup after previous build -------------------------------------------- 1.65s
tensorflow_in_container : (Python 3.8) cleanup Bazel install directory --- 1.53s
tensorflow : Save git commit hash to file ------------------------------- 1.46s
tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 1.02s
tensorflow : Create readme file about unit tests ------------------------ 0.89s
Build step 'Execute shell' marked build as failure
1 week, 1 day
- 1
- 1
Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #717
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/717/disp…>
Changes:
------------------------------------------
[...truncated 21.77 KB...]
TASK [tensorflow_in_container : (Python 3.8) create link for pip cache] ********
Tuesday 07 March 2023 18:10:54 +0000 (0:00:00.812) 0:00:49.753 *********
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build] ***
Tuesday 07 March 2023 18:10:55 +0000 (0:00:00.829) 0:00:50.583 *********
changed: [localhost]
TASK [tensorflow_in_container : Show list of installed Python packages for build] ***
Tuesday 07 March 2023 18:10:57 +0000 (0:00:02.140) 0:00:52.724 *********
ok: [localhost] =>
pip_list_output.stdout: |-
Package Version Location Installer
----------------------- -------------------- -------------------------------------- ---------
absl-py 1.0.0 /usr/local/lib/python3.8/dist-packages pip
astor 0.8.1 /usr/local/lib/python3.8/dist-packages pip
astroid 2.11.7 /usr/local/lib/python3.8/dist-packages pip
astunparse 1.6.3 /usr/local/lib/python3.8/dist-packages pip
auditwheel 5.3.0 /usr/local/lib/python3.8/dist-packages pip
bleach 6.0.0 /usr/local/lib/python3.8/dist-packages pip
cachetools 5.3.0 /usr/local/lib/python3.8/dist-packages pip
certifi 2019.11.28 /usr/lib/python3/dist-packages
cffi 1.15.1 /usr/local/lib/python3.8/dist-packages pip
chardet 3.0.4 /usr/lib/python3/dist-packages
colorama 0.4.6 /usr/local/lib/python3.8/dist-packages pip
cryptography 39.0.1 /usr/local/lib/python3.8/dist-packages pip
Cython 0.29.33 /usr/local/lib/python3.8/dist-packages pip
dbus-python 1.2.16 /usr/lib/python3/dist-packages
dill 0.3.6 /usr/local/lib/python3.8/dist-packages pip
docutils 0.19 /usr/local/lib/python3.8/dist-packages pip
flatbuffers 2.0.7 /usr/local/lib/python3.8/dist-packages pip
future 0.18.3 /usr/local/lib/python3.8/dist-packages pip
gast 0.4.0 /usr/local/lib/python3.8/dist-packages pip
google-auth 2.16.1 /usr/local/lib/python3.8/dist-packages pip
google-auth-oauthlib 0.4.6 /usr/local/lib/python3.8/dist-packages pip
google-pasta 0.2.0 /usr/local/lib/python3.8/dist-packages pip
grpcio 1.49.1 /usr/local/lib/python3.8/dist-packages pip
h5py 3.8.0 /usr/local/lib/python3.8/dist-packages pip
idna 2.8 /usr/lib/python3/dist-packages
importlib-metadata 6.0.0 /usr/local/lib/python3.8/dist-packages pip
importlib-resources 5.12.0 /usr/local/lib/python3.8/dist-packages pip
isort 5.12.0 /usr/local/lib/python3.8/dist-packages pip
jaraco.classes 3.2.3 /usr/local/lib/python3.8/dist-packages pip
jax 0.3.25 /usr/local/lib/python3.8/dist-packages pip
jeepney 0.8.0 /usr/local/lib/python3.8/dist-packages pip
junitparser 2.2.0 /usr/local/lib/python3.8/dist-packages pip
Keras-Applications 1.0.8 /usr/local/lib/python3.8/dist-packages pip
keras-nightly 2.13.0.dev2023022708 /usr/local/lib/python3.8/dist-packages pip
Keras-Preprocessing 1.1.2 /usr/local/lib/python3.8/dist-packages pip
keyring 23.13.1 /usr/local/lib/python3.8/dist-packages pip
lazy-object-proxy 1.9.0 /usr/local/lib/python3.8/dist-packages pip
lxml 4.9.2 /usr/local/lib/python3.8/dist-packages pip
Markdown 3.4.1 /usr/local/lib/python3.8/dist-packages pip
MarkupSafe 2.1.2 /usr/local/lib/python3.8/dist-packages pip
mccabe 0.7.0 /usr/local/lib/python3.8/dist-packages pip
more-itertools 9.0.0 /usr/local/lib/python3.8/dist-packages pip
numpy 1.23.5 /usr/local/lib/python3.8/dist-packages pip
oauthlib 3.2.2 /usr/local/lib/python3.8/dist-packages pip
opt-einsum 3.3.0 /usr/local/lib/python3.8/dist-packages pip
packaging 21.3 /usr/local/lib/python3.8/dist-packages pip
pip 23.0.1 /usr/local/lib/python3.8/dist-packages pip
pkginfo 1.9.6 /usr/local/lib/python3.8/dist-packages pip
platformdirs 3.0.0 /usr/local/lib/python3.8/dist-packages pip
portpicker 1.4.0 /usr/local/lib/python3.8/dist-packages pip
protobuf 4.22.0 /usr/local/lib/python3.8/dist-packages pip
pyasn1 0.4.8 /usr/local/lib/python3.8/dist-packages pip
pyasn1-modules 0.2.8 /usr/local/lib/python3.8/dist-packages pip
pycparser 2.21 /usr/local/lib/python3.8/dist-packages pip
pyelftools 0.29 /usr/local/lib/python3.8/dist-packages pip
Pygments 2.14.0 /usr/local/lib/python3.8/dist-packages pip
PyGObject 3.36.0 /usr/lib/python3/dist-packages
pylint 2.13.9 /usr/local/lib/python3.8/dist-packages pip
pyparsing 3.0.9 /usr/local/lib/python3.8/dist-packages pip
python-apt 2.0.1 /usr/lib/python3/dist-packages
PyYAML 6.0 /usr/local/lib/python3.8/dist-packages pip
readme-renderer 37.3 /usr/local/lib/python3.8/dist-packages pip
requests 2.22.0 /usr/lib/python3/dist-packages
requests-oauthlib 1.3.1 /usr/local/lib/python3.8/dist-packages pip
requests-toolbelt 0.10.1 /usr/local/lib/python3.8/dist-packages pip
requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages
rfc3986 2.0.0 /usr/local/lib/python3.8/dist-packages pip
rsa 4.9 /usr/local/lib/python3.8/dist-packages pip
scipy 1.9.3 /usr/local/lib/python3.8/dist-packages pip
SecretStorage 3.3.3 /usr/local/lib/python3.8/dist-packages pip
setuptools 45.2.0 /usr/lib/python3/dist-packages
six 1.15.0 /usr/local/lib/python3.8/dist-packages pip
tb-nightly 2.13.0a20230226 /usr/local/lib/python3.8/dist-packages pip
tensorboard-data-server 0.7.0 /usr/local/lib/python3.8/dist-packages pip
tensorboard-plugin-wit 1.8.1 /usr/local/lib/python3.8/dist-packages pip
termcolor 1.1.0 /usr/local/lib/python3.8/dist-packages pip
tf-estimator-nightly 2.13.0.dev2023022709 /usr/local/lib/python3.8/dist-packages pip
tomli 2.0.1 /usr/local/lib/python3.8/dist-packages pip
tqdm 4.64.1 /usr/local/lib/python3.8/dist-packages pip
twine 3.6.0 /usr/local/lib/python3.8/dist-packages pip
typing-extensions 3.7.4.3 /usr/local/lib/python3.8/dist-packages pip
urllib3 1.25.8 /usr/lib/python3/dist-packages
webencodings 0.5.1 /usr/local/lib/python3.8/dist-packages pip
Werkzeug 2.2.3 /usr/local/lib/python3.8/dist-packages pip
wheel 0.38.4 /usr/local/lib/python3.8/dist-packages pip
wrapt 1.12.1 /usr/local/lib/python3.8/dist-packages pip
zipp 3.14.0 /usr/local/lib/python3.8/dist-packages pip
TASK [tensorflow_in_container : (Python 3.8) build TensorFlow git] *************
Tuesday 07 March 2023 18:10:57 +0000 (0:00:00.046) 0:00:52.770 *********
fatal: [localhost]: FAILED! => changed=true
rc: 1
stderr: |-
Extracting Bazel installation...
Starting local Bazel server and connecting to it...
INFO: Invocation ID: 3d57f278-65ce-4834-b25a-aef170e22300
INFO: Options provided by the client:
Inherited 'common' options: --isatty=0 --terminal_columns=80
INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc:
Inherited 'common' options: --experimental_repo_remote_exec
INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc:
'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils
INFO: Reading rc options for 'build' from /usertools/aarch64.bazelrc:
'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/local/bin/python3 --python_path=/usr/local/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --distinct_host_configuration=false --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3
INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING
INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64.bazelrc: --disk_cache=/tf/cache
INFO: Found applicable config definition build:ambe in file /usertools/aarch64.bazelrc: --distinct_host_configuration=false --flaky_test_attempts=3 --action_env=PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin --host_crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --extra_toolchains=@ml2014_aarch64_config_aarch64//crosstool:toolchain-linux-aarch64 --extra_execution_platforms=@ml2014_aarch64_config_aarch64_platform//:platform --host_platform=@ml2014_aarch64_config_aarch64_platform//:platform --platforms=@ml2014_aarch64_config_aarch64_platform//:platform --repo_env=TF_PYTHON_CONFIG_REPO=@ml2014_aarch64_config_python
INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes
INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS
Loading:
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/tensorflow/… failed: class java.io.FileNotFoundException GET returned 404 Not Found
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-p… failed: class java.io.FileNotFoundException GET returned 404 Not Found
Loading: 0 packages loaded
Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured)
Analyzing: target //tensorflow/tools/pip_package:build_pip_package (290 packages loaded, 4320 targets configured)
INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (592 packages loaded, 33871 targets configured).
INFO: Found 1 target...
[0 / 186] [Prepa] Creating source manifest for //tensorflow/python/tools:freeze_graph ... (33 actions, 0 running)
[10,966 / 23,540] Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local, remote-cache ... (111 actions, 110 running)
[11,037 / 23,540] Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local, remote-cache ... (111 actions, 110 running)
[11,150 / 23,540] Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local, remote-cache ... (111 actions, 110 running)
[11,228 / 23,540] Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 47s local, remote-cache ... (111 actions, 110 running)
[11,506 / 23,540] Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 65s local, remote-cache ... (111 actions, 110 running)
[11,814 / 23,540] Compiling tensorflow/compiler/tf2xla/ops/xla_ops.cc; 12s local, remote-cache ... (111 actions, 110 running)
[12,004 / 23,540] Compiling tensorflow/core/kernels/set_kernels.cc; 35s local, remote-cache ... (111 actions, 110 running)
[12,205 / 23,540] Compiling tensorflow/core/kernels/padding_fifo_queue.cc; 27s local, remote-cache ... (111 actions, 110 running)
[12,427 / 23,540] Compiling tensorflow/core/kernels/padding_fifo_queue.cc; 58s local, remote-cache ... (111 actions, 110 running)
[12,653 / 23,540] Compiling tensorflow/core/kernels/lrn_op.cc; 47s local, remote-cache ... (111 actions, 110 running)
[13,473 / 23,540] Compiling tensorflow/core/kernels/bias_op.cc; 53s local, remote-cache ... (111 actions, 110 running)
[13,701 / 23,540] Compiling tensorflow/core/kernels/training_ops.cc; 97s local, remote-cache ... (111 actions, 110 running)
[14,097 / 23,540] Compiling tensorflow/core/kernels/training_ops.cc; 152s local, remote-cache ... (111 actions, 110 running)
[14,526 / 23,540] Compiling tensorflow/core/kernels/rnn/lstm_ops.cc; 38s local, remote-cache ... (111 actions, 110 running)
[15,194 / 23,540] Compiling tensorflow/core/util/batch_util.cc; 31s local, remote-cache ... (111 actions, 110 running)
[16,155 / 23,612] Compiling tensorflow/core/util/batch_util.cc; 115s local, remote-cache ... (111 actions, 110 running)
[16,623 / 23,612] Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 40s local, remote-cache ... (111 actions, 110 running)
[17,282 / 23,612] Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 54s local, remote-cache ... (111 actions, 110 running)
[19,468 / 23,612] Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 56s local, remote-cache ... (111 actions, 110 running)
[20,133 / 23,612] Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 145s local, remote-cache ... (111 actions, 110 running)
[20,768 / 23,612] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops.cc; 147s local, remote-cache ... (111 actions, 110 running)
[21,075 / 23,612] Compiling tensorflow/core/kernels/matmul_op_real.cc; 260s local, remote-cache ... (111 actions, 110 running)
[21,786 / 23,612] Compiling tensorflow/core/kernels/conv_grad_ops_3d.cc; 336s local, remote-cache ... (111 actions, 110 running)
[22,841 / 23,612] Compiling stablehlo/dialect/StablehloOps.cpp; 82s local, remote-cache ... (111 actions, 110 running)
[23,533 / 23,612] Compiling tensorflow/compiler/mlir/lite/ir/tfl_ops.cc; 192s local, remote-cache ... (14 actions running)
[23,546 / 23,612] Linking tensorflow/libtensorflow_cc.so.2.13.0; 232s local, remote-cache
[23,546 / 23,612] Linking tensorflow/libtensorflow_cc.so.2.13.0; 620s local, remote-cache
ERROR: /tf/tensorflow/tensorflow/BUILD:1635:19: Executing genrule //tensorflow:tf_python_api_gen_v2 failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped)
Traceback (most recent call last):
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/tools/api/generator/create_python_api.py", line 22, in <module>
from tensorflow.python.tools.api.generator import doc_srcs
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/__init__.py", line 42, in <module>
from tensorflow.python import data
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/__init__.py", line 21, in <module>
from tensorflow.python.data import experimental
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/experimental/__init__.py", line 97, in <module>
from tensorflow.python.data.experimental import service
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/experimental/service/__init__.py", line 419, in <module>
from tensorflow.python.data.experimental.ops.data_service_ops import distribute
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/experimental/ops/data_service_ops.py", line 22, in <module>
from tensorflow.python.data.experimental.ops import compression_ops
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/experimental/ops/compression_ops.py", line 16, in <module>
from tensorflow.python.data.util import structure
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/util/structure.py", line 30, in <module>
from tensorflow.python.ops import resource_variable_ops
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/ops/resource_variable_ops.py", line 41, in <module>
from tensorflow.python.framework import meta_graph
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/framework/meta_graph.py", line 34, in <module>
from tensorflow.python.framework import importer
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/framework/importer.py", line 24, in <module>
from tensorflow.python.framework import function
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/framework/function.py", line 34, in <module>
from tensorflow.python.ops import variable_scope as vs
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/ops/variable_scope.py", line 25, in <module>
from tensorflow.python.client import session
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/client/session.py", line 37, in <module>
from tensorflow.python.ops import session_ops
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/ops/session_ops.py", line 27, in <module>
from tensorflow.python.ops import gen_data_flow_ops
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/ops/gen_data_flow_ops.py", line 726, in <module>
def dynamic_stitch(indices: list[_atypes.TensorFuzzingAnnotation[_atypes.Int32]], data: list[_atypes.TensorFuzzingAnnotation[TV_DynamicStitch_T]], name=None) -> _atypes.TensorFuzzingAnnotation[TV_DynamicStitch_T]:
TypeError: 'type' object is not subscriptable
Target //tensorflow/tools/pip_package:build_pip_package failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /tf/tensorflow/tensorflow/lite/python/BUILD:72:10 Middleman _middlemen/tensorflow_Slite_Spython_Stflite_Uconvert-runfiles failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped)
INFO: Elapsed time: 2996.839s, Critical Path: 1275.76s
INFO: 23611 processes: 9505 disk cache hit, 5556 internal, 8550 local.
FAILED: Build did NOT complete successfully
FAILED: Build did NOT complete successfully
stderr_lines: <omitted>
stdout: ''
stdout_lines: <omitted>
PLAY RECAP *********************************************************************
localhost : ok=29 changed=21 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0
Tuesday 07 March 2023 19:00:55 +0000 (0:49:58.121) 0:50:50.891 *********
===============================================================================
tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 2998.12s
tensorflow : Fetch TensorFlow from git --------------------------------- 24.03s
tensorflow : Remove TensorFlow git sources from previous build ---------- 3.91s
tensorflow_in_container : (Python 3.8) start build container ------------ 3.88s
Gathering Facts --------------------------------------------------------- 2.67s
tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build --- 2.14s
tensorflow_in_container : (Python 3.8) build Python versioned container --- 1.51s
Create cache dirs ------------------------------------------------------- 1.38s
Cleanup after previous build -------------------------------------------- 1.28s
tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.19s
tensorflow : Save git commit hash to file ------------------------------- 1.11s
tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.84s
tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.83s
tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.81s
tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.75s
tensorflow : Create readme file about unit tests ------------------------ 0.70s
tensorflow : Create linklibs shell script ------------------------------- 0.69s
Build TensorFlow for each Python version (dual abi) --------------------- 0.66s
tensorflow_in_container : Reset checkout to clean state ----------------- 0.63s
tensorflow : Get oneline version of git log for this checkout ----------- 0.61s
Build step 'Execute shell' marked build as failure
2 weeks, 2 days
- 1
- 2
Build failed in Jenkins: Tensorflow oneDNN Python package (manylinux2014 nightly) #361
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/3…>
Changes:
------------------------------------------
[...truncated 22.15 KB...]
TASK [tensorflow_in_container : (Python 3.8) create link for pip cache] ********
Wednesday 08 March 2023 01:56:50 +0000 (0:00:00.809) 0:00:45.973 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build] ***
Wednesday 08 March 2023 01:56:51 +0000 (0:00:00.803) 0:00:46.777 *******
changed: [localhost]
TASK [tensorflow_in_container : Show list of installed Python packages for build] ***
Wednesday 08 March 2023 01:56:53 +0000 (0:00:02.012) 0:00:48.789 *******
ok: [localhost] =>
pip_list_output.stdout: |-
Package Version Location Installer
----------------------- -------------------- -------------------------------------- ---------
absl-py 1.0.0 /usr/local/lib/python3.8/dist-packages pip
astor 0.8.1 /usr/local/lib/python3.8/dist-packages pip
astroid 2.11.7 /usr/local/lib/python3.8/dist-packages pip
astunparse 1.6.3 /usr/local/lib/python3.8/dist-packages pip
auditwheel 5.3.0 /usr/local/lib/python3.8/dist-packages pip
bleach 6.0.0 /usr/local/lib/python3.8/dist-packages pip
cachetools 5.3.0 /usr/local/lib/python3.8/dist-packages pip
certifi 2019.11.28 /usr/lib/python3/dist-packages
cffi 1.15.1 /usr/local/lib/python3.8/dist-packages pip
chardet 3.0.4 /usr/lib/python3/dist-packages
colorama 0.4.6 /usr/local/lib/python3.8/dist-packages pip
cryptography 39.0.1 /usr/local/lib/python3.8/dist-packages pip
Cython 0.29.33 /usr/local/lib/python3.8/dist-packages pip
dbus-python 1.2.16 /usr/lib/python3/dist-packages
dill 0.3.6 /usr/local/lib/python3.8/dist-packages pip
docutils 0.19 /usr/local/lib/python3.8/dist-packages pip
flatbuffers 2.0.7 /usr/local/lib/python3.8/dist-packages pip
future 0.18.3 /usr/local/lib/python3.8/dist-packages pip
gast 0.4.0 /usr/local/lib/python3.8/dist-packages pip
google-auth 2.16.2 /usr/local/lib/python3.8/dist-packages pip
google-auth-oauthlib 0.4.6 /usr/local/lib/python3.8/dist-packages pip
google-pasta 0.2.0 /usr/local/lib/python3.8/dist-packages pip
grpcio 1.49.1 /usr/local/lib/python3.8/dist-packages pip
h5py 3.8.0 /usr/local/lib/python3.8/dist-packages pip
idna 2.8 /usr/lib/python3/dist-packages
importlib-metadata 6.0.0 /usr/local/lib/python3.8/dist-packages pip
importlib-resources 5.12.0 /usr/local/lib/python3.8/dist-packages pip
isort 5.12.0 /usr/local/lib/python3.8/dist-packages pip
jaraco.classes 3.2.3 /usr/local/lib/python3.8/dist-packages pip
jax 0.3.25 /usr/local/lib/python3.8/dist-packages pip
jeepney 0.8.0 /usr/local/lib/python3.8/dist-packages pip
junitparser 2.2.0 /usr/local/lib/python3.8/dist-packages pip
Keras-Applications 1.0.8 /usr/local/lib/python3.8/dist-packages pip
keras-nightly 2.13.0.dev2023030308 /usr/local/lib/python3.8/dist-packages pip
Keras-Preprocessing 1.1.2 /usr/local/lib/python3.8/dist-packages pip
keyring 23.13.1 /usr/local/lib/python3.8/dist-packages pip
lazy-object-proxy 1.9.0 /usr/local/lib/python3.8/dist-packages pip
lxml 4.9.2 /usr/local/lib/python3.8/dist-packages pip
Markdown 3.4.1 /usr/local/lib/python3.8/dist-packages pip
MarkupSafe 2.1.2 /usr/local/lib/python3.8/dist-packages pip
mccabe 0.7.0 /usr/local/lib/python3.8/dist-packages pip
more-itertools 9.0.0 /usr/local/lib/python3.8/dist-packages pip
numpy 1.23.5 /usr/local/lib/python3.8/dist-packages pip
oauthlib 3.2.2 /usr/local/lib/python3.8/dist-packages pip
opt-einsum 3.3.0 /usr/local/lib/python3.8/dist-packages pip
packaging 21.3 /usr/local/lib/python3.8/dist-packages pip
pip 23.0.1 /usr/local/lib/python3.8/dist-packages pip
pkginfo 1.9.6 /usr/local/lib/python3.8/dist-packages pip
platformdirs 3.0.0 /usr/local/lib/python3.8/dist-packages pip
portpicker 1.4.0 /usr/local/lib/python3.8/dist-packages pip
protobuf 4.22.0 /usr/local/lib/python3.8/dist-packages pip
pyasn1 0.4.8 /usr/local/lib/python3.8/dist-packages pip
pyasn1-modules 0.2.8 /usr/local/lib/python3.8/dist-packages pip
pycparser 2.21 /usr/local/lib/python3.8/dist-packages pip
pyelftools 0.29 /usr/local/lib/python3.8/dist-packages pip
Pygments 2.14.0 /usr/local/lib/python3.8/dist-packages pip
PyGObject 3.36.0 /usr/lib/python3/dist-packages
pylint 2.13.9 /usr/local/lib/python3.8/dist-packages pip
pyparsing 3.0.9 /usr/local/lib/python3.8/dist-packages pip
python-apt 2.0.1 /usr/lib/python3/dist-packages
PyYAML 6.0 /usr/local/lib/python3.8/dist-packages pip
readme-renderer 37.3 /usr/local/lib/python3.8/dist-packages pip
requests 2.22.0 /usr/lib/python3/dist-packages
requests-oauthlib 1.3.1 /usr/local/lib/python3.8/dist-packages pip
requests-toolbelt 0.10.1 /usr/local/lib/python3.8/dist-packages pip
requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages
rfc3986 2.0.0 /usr/local/lib/python3.8/dist-packages pip
rsa 4.9 /usr/local/lib/python3.8/dist-packages pip
scipy 1.9.3 /usr/local/lib/python3.8/dist-packages pip
SecretStorage 3.3.3 /usr/local/lib/python3.8/dist-packages pip
setuptools 45.2.0 /usr/lib/python3/dist-packages
six 1.15.0 /usr/local/lib/python3.8/dist-packages pip
tb-nightly 2.13.0a20230303 /usr/local/lib/python3.8/dist-packages pip
tensorboard-data-server 0.7.0 /usr/local/lib/python3.8/dist-packages pip
tensorboard-plugin-wit 1.8.1 /usr/local/lib/python3.8/dist-packages pip
termcolor 1.1.0 /usr/local/lib/python3.8/dist-packages pip
tf-estimator-nightly 2.13.0.dev2023030309 /usr/local/lib/python3.8/dist-packages pip
tomli 2.0.1 /usr/local/lib/python3.8/dist-packages pip
tqdm 4.64.1 /usr/local/lib/python3.8/dist-packages pip
twine 3.6.0 /usr/local/lib/python3.8/dist-packages pip
typing-extensions 3.7.4.3 /usr/local/lib/python3.8/dist-packages pip
urllib3 1.25.8 /usr/lib/python3/dist-packages
webencodings 0.5.1 /usr/local/lib/python3.8/dist-packages pip
Werkzeug 2.2.3 /usr/local/lib/python3.8/dist-packages pip
wheel 0.38.4 /usr/local/lib/python3.8/dist-packages pip
wrapt 1.12.1 /usr/local/lib/python3.8/dist-packages pip
zipp 3.14.0 /usr/local/lib/python3.8/dist-packages pip
TASK [tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git] ***
Wednesday 08 March 2023 01:56:53 +0000 (0:00:00.047) 0:00:48.836 *******
fatal: [localhost]: FAILED! => changed=true
rc: 1
stderr: |-
Extracting Bazel installation...
Starting local Bazel server and connecting to it...
INFO: Invocation ID: f881e1d1-e998-4247-bb3f-dd72a52a247b
INFO: Options provided by the client:
Inherited 'common' options: --isatty=0 --terminal_columns=80
INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc:
Inherited 'common' options: --experimental_repo_remote_exec
INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc:
'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils
INFO: Reading rc options for 'build' from /usertools/aarch64.bazelrc:
'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/local/bin/python3 --python_path=/usr/local/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --distinct_host_configuration=false --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3
INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING
INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64.bazelrc: --disk_cache=/tf/cache
INFO: Found applicable config definition build:ambe in file /usertools/aarch64.bazelrc: --distinct_host_configuration=false --flaky_test_attempts=3 --action_env=PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin --host_crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --extra_toolchains=@ml2014_aarch64_config_aarch64//crosstool:toolchain-linux-aarch64 --extra_execution_platforms=@ml2014_aarch64_config_aarch64_platform//:platform --host_platform=@ml2014_aarch64_config_aarch64_platform//:platform --platforms=@ml2014_aarch64_config_aarch64_platform//:platform --repo_env=TF_PYTHON_CONFIG_REPO=@ml2014_aarch64_config_python
INFO: Found applicable config definition build:mkl_aarch64_threadpool in file /tf/tensorflow/.bazelrc: --define=build_with_mkl_aarch64=true -c opt
INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes
INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS
Loading:
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/tensorflow/… failed: class java.io.FileNotFoundException GET returned 404 Not Found
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-p… failed: class java.io.FileNotFoundException GET returned 404 Not Found
Loading: 0 packages loaded
Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured)
Analyzing: target //tensorflow/tools/pip_package:build_pip_package (288 packages loaded, 4267 targets configured)
WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/openxla/sta… failed: class java.io.FileNotFoundException GET returned 404 Not Found
INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (595 packages loaded, 37117 targets configured).
INFO: Found 1 target...
[0 / 174] [Prepa] Expanding template tensorflow/python/debug/lib/grpc_tensorflow_server ... (12 actions, 0 running)
[766 / 2,086] Compiling llvm/lib/Support/APFloat.cpp; 9s local, remote-cache ... (110 actions, 108 running)
[961 / 2,086] Compiling llvm/utils/TableGen/CodeGenRegisters.cpp; 20s local, remote-cache ... (111 actions, 110 running)
[3,293 / 5,035] Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp; 32s local, remote-cache ... (111 actions, 110 running)
[3,470 / 5,035] Compiling tensorflow/tsl/profiler/utils/xplane_builder.cc; 9s local, remote-cache ... (109 actions, 108 running)
[5,066 / 7,212] Compiling tensorflow/compiler/xla/stream_executor/stream.cc; 24s local, remote-cache ... (111 actions, 110 running)
[6,006 / 7,810] Compiling tensorflow/compiler/xla/stream_executor/stream.cc; 15s local, remote-cache ... (111 actions, 110 running)
[6,174 / 7,810] Compiling mlir/lib/IR/BuiltinAttributes.cpp; 26s local, remote-cache ... (111 actions, 110 running)
[6,442 / 7,898] Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local, remote-cache ... (111 actions, 110 running)
[7,144 / 8,672] Compiling tensorflow/core/ir/ops.cc; 51s local, remote-cache ... (111 actions, 110 running)
[7,477 / 8,796] Compiling tensorflow/compiler/xla/literal.cc; 42s local, remote-cache ... (111 actions, 110 running)
[7,737 / 8,796] Compiling tensorflow/core/util/batch_util.cc; 61s local, remote-cache ... (111 actions, 110 running)
[8,032 / 8,796] Compiling tensorflow/core/util/batch_util.cc; 108s local, remote-cache ... (111 actions, 110 running)
[8,358 / 8,796] Compiling tensorflow/core/util/batch_util.cc; 29s local, remote-cache ... (111 actions, 110 running)
[9,971 / 10,300] Compiling tensorflow/lite/kernels/fully_connected.cc; 24s local, remote-cache ... (111 actions, 110 running)
[11,385 / 11,677] Compiling tensorflow/core/transforms/constant_folding/pass.cc; 46s local, remote-cache ... (111 actions, 110 running)
[14,211 / 16,349] Compiling tensorflow/core/kernels/image/colorspace_op.cc; 38s local, remote-cache ... (111 actions, 110 running)
[14,845 / 16,913] Compiling tensorflow/core/kernels/linalg/svd_op_complex128.cc; 125s local, remote-cache ... (111 actions, 110 running)
[15,182 / 17,273] Compiling tensorflow/core/kernels/linalg/matrix_square_root_op.cc; 228s local, remote-cache ... (111 actions, 110 running)
[15,683 / 17,679] Compiling tensorflow/compiler/mlir/lite/ir/tfl_ops.cc; 139s local, remote-cache ... (111 actions, 110 running)
[16,706 / 18,416] Compiling tensorflow/core/kernels/broadcast_to_op.cc; 138s local, remote-cache ... (111 actions, 110 running)
[17,318 / 18,868] Compiling tensorflow/compiler/xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 170s local, remote-cache ... (111 actions, 110 running)
[18,684 / 19,983] Compiling tensorflow/core/kernels/cwise_op_select.cc; 282s local, remote-cache ... (111 actions, 110 running)
[19,809 / 20,973] Compiling tensorflow/core/kernels/matmul_op_real.cc; 348s local, remote-cache ... (111 actions, 110 running)
[22,216 / 23,113] Compiling tensorflow/core/kernels/mkl/mkl_cwise_ops_common.cc; 182s local, remote-cache ... (111 actions, 110 running)
[24,254 / 24,668] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops_a_m.cc; 180s local, remote-cache ... (111 actions, 110 running)
[24,644 / 24,710] Linking tensorflow/libtensorflow_cc.so.2.13.0; 201s local, remote-cache
ERROR: /tf/tensorflow/tensorflow/BUILD:1635:19: Executing genrule //tensorflow:tf_python_api_gen_v2 failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped)
Traceback (most recent call last):
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/tools/api/generator/create_python_api.py", line 22, in <module>
from tensorflow.python.tools.api.generator import doc_srcs
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/__init__.py", line 42, in <module>
from tensorflow.python import data
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/__init__.py", line 21, in <module>
from tensorflow.python.data import experimental
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/experimental/__init__.py", line 97, in <module>
from tensorflow.python.data.experimental import service
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/experimental/service/__init__.py", line 419, in <module>
from tensorflow.python.data.experimental.ops.data_service_ops import distribute
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/experimental/ops/data_service_ops.py", line 22, in <module>
from tensorflow.python.data.experimental.ops import compression_ops
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/experimental/ops/compression_ops.py", line 16, in <module>
from tensorflow.python.data.util import structure
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/util/structure.py", line 30, in <module>
from tensorflow.python.ops import resource_variable_ops
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/ops/resource_variable_ops.py", line 41, in <module>
from tensorflow.python.framework import meta_graph
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/framework/meta_graph.py", line 34, in <module>
from tensorflow.python.framework import importer
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/framework/importer.py", line 24, in <module>
from tensorflow.python.framework import function
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/framework/function.py", line 34, in <module>
from tensorflow.python.ops import variable_scope as vs
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/ops/variable_scope.py", line 25, in <module>
from tensorflow.python.client import session
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/client/session.py", line 38, in <module>
from tensorflow.python.ops import session_ops
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/ops/session_ops.py", line 27, in <module>
from tensorflow.python.ops import gen_data_flow_ops
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/ops/gen_data_flow_ops.py", line 726, in <module>
def dynamic_stitch(indices: list[_atypes.TensorFuzzingAnnotation[_atypes.Int32]], data: list[_atypes.TensorFuzzingAnnotation[TV_DynamicStitch_T]], name=None) -> _atypes.TensorFuzzingAnnotation[TV_DynamicStitch_T]:
TypeError: 'type' object is not subscriptable
Target //tensorflow/tools/pip_package:build_pip_package failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /tf/tensorflow/tensorflow/python/tools/BUILD:282:10 Middleman _middlemen/tensorflow_Spython_Stools_Sprint_Uselective_Uregistration_Uheader-runfiles failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped)
INFO: Elapsed time: 2891.378s, Critical Path: 1109.12s
INFO: 24709 processes: 10076 disk cache hit, 5612 internal, 9021 local.
FAILED: Build did NOT complete successfully
FAILED: Build did NOT complete successfully
stderr_lines: <omitted>
stdout: ''
stdout_lines: <omitted>
PLAY RECAP *********************************************************************
localhost : ok=29 changed=21 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0
Wednesday 08 March 2023 02:45:05 +0000 (0:48:12.561) 0:49:01.398 *******
===============================================================================
tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git 2892.56s
tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 21.39s
tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.87s
tensorflow_in_container : (Python 3.8) start build container ------------ 3.86s
tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build --- 2.01s
Gathering Facts --------------------------------------------------------- 1.62s
tensorflow_in_container : (Python 3.8) build Python versioned container --- 1.51s
Create cache dirs ------------------------------------------------------- 1.38s
Cleanup after previous build -------------------------------------------- 1.28s
tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.20s
tensorflow : Save git commit hash to file ------------------------------- 1.11s
tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.83s
tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.81s
tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.80s
tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.72s
tensorflow : Create readme file about unit tests ------------------------ 0.70s
tensorflow : Create linklibs shell script ------------------------------- 0.69s
Build TensorFlow for each Python version (dual abi) --------------------- 0.64s
tensorflow_in_container : Reset checkout to clean state ----------------- 0.64s
tensorflow : Get oneline version of git log for this checkout ----------- 0.59s
Build step 'Execute shell' marked build as failure
2 weeks, 3 days
- 1
- 1
Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #709
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/709/disp…>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on ldcg-aarch64-02 (aarch64 leg-aarch64) in workspace <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/>
[ldcg-python-manylinux-tensorflow-nightly] $ /bin/bash /tmp/jenkins5574223505825888602.sh
+ dual_abi=false
+ cd <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/>
+ rm -rf '*.sh' configs wheels cache_upload
+ mkdir wheels cache_upload
+ git clone --depth 1 https://git.linaro.org/ci/job/configs.git
Cloning into 'configs'...
+ cd configs
+ git log --pretty=oneline -1
4589cc3ca8c2e214a46c15ea9c7ba36c630b2bc6 tcwg_bmk: Set cflags configuration based on PROFILE name
+ cd ..
+ '[' '' = true ']'
+ '[' '' = true ']'
+ '[' '' = true ']'
+ '[' '' = true ']'
+ '[' '' = true ']'
+ '[' '' = true ']'
+ '[' '' = true ']'
+ '[' '' = true ']'
+ '[' '' = true ']'
+ '[' '' = true ']'
+ '[' true = true ']'
+ echo ' - "git"'
+ dual_abi=true
+ '[' false = true ']'
+ '[' '' = true ']'
+ '[' '' = true ']'
+ '[' true == true ']'
+ ansible-galaxy collection install community.docker
Starting galaxy collection install process
Nothing to do. All requested collections are already installed. If you want to reinstall them, consider using `--force`.
+ cd configs/ldcg-python-manylinux-tensorflow/ansible/
+ sed -i -es+/tmp/workspace+<https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/+g> vars/vars.yml
+ ansible-playbook playbooks/build-tf-dual-abi.yml
[WARNING]: provided hosts list is empty, only localhost is available. Note that
the implicit localhost does not match 'all'
PLAY [Build TensorFlow in Dual ABI container] **********************************
TASK [Gathering Facts] *********************************************************
Thursday 02 March 2023 18:10:04 +0000 (0:00:00.062) 0:00:00.062 ********
ok: [localhost]
TASK [Cleanup after previous build] ********************************************
Thursday 02 March 2023 18:10:06 +0000 (0:00:01.642) 0:00:01.705 ********
changed: [localhost] => (item=wheels)
changed: [localhost] => (item=ml_wheels)
ok: [localhost] => (item=tensorflow)
TASK [Create cache dirs] *******************************************************
Thursday 02 March 2023 18:10:07 +0000 (0:00:01.278) 0:00:02.984 ********
ok: [localhost] => (item=disk-cache)
ok: [localhost] => (item=bazel-cache)
changed: [localhost] => (item=wheels)
changed: [localhost] => (item=ml_wheels)
TASK [Set dual abi variable] ***************************************************
Thursday 02 March 2023 18:10:08 +0000 (0:00:01.384) 0:00:04.368 ********
ok: [localhost]
TASK [Go through each TensorFlow version] **************************************
Thursday 02 March 2023 18:10:08 +0000 (0:00:00.038) 0:00:04.406 ********
skipping: [localhost] => (item={'key': '2.12', 'value': {'tensorflow_version': '2.12.0-rc0', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.12.0rc0', 'tensorboard_version': '==2.12.0', 'tensorflow_estimator_version': '==2.12.0rc0', 'image_prefix': '2.12', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/core/platform:ram_file_system_test', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/compiler/xla:xla_test_cpu', '//tensorflow/python/data/experimental/kernel_tests:checkpoint_input_pipeline_hook_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/distribute:parameter_server_strategy_test_cpu', '//tensorflow/python/distribute:parameter_server_strategy_test_2gpu', '//tensorflow/python/kernel_tests/linalg:matrix_triangular_solve_op_test', '//tensorflow/python/training:server_lib_test', '//tensorflow/tsl/framework/convolution:spatial_convolutions_test'], 'serial_unit_tests_exclude': ['//tensorflow/python/debug/lib:source_remote_test'], 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-no_oss_py38,-no_oss_py39,-no_oss_py310', 'python_versions': ['3.8', '3.9', '3.10', '3.11']}})
skipping: [localhost] => (item={'key': '2.11', 'value': {'tensorflow_version': '2.11.0', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.11.0', 'tensorboard_version': '==2.11.2', 'tensorflow_estimator_version': '==2.11.0', 'image_prefix': '', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/training:server_lib_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}})
skipping: [localhost] => (item={'key': '2.10', 'value': {'tensorflow_version': '2.10.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.10.0', 'tensorboard_version': '==2.10.1', 'tensorflow_estimator_version': '==2.10.0', 'image_prefix': '', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tensorflow/tests/...', '//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/tests:jit_test_cpu', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/training:server_lib_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}})
skipping: [localhost] => (item={'key': '2.9', 'value': {'tensorflow_version': '2.9.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.9.0', 'tensorboard_version': '==2.9.0', 'tensorflow_estimator_version': '==2.9.0', 'image_prefix': '', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}})
skipping: [localhost] => (item={'key': '2.8', 'value': {'tensorflow_version': '2.8.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.8.0', 'tensorboard_version': '==2.8.0', 'tensorflow_estimator_version': '==2.8.0', 'image_prefix': '', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/mlir/lite/tests:prepare-tf.mlir.test', '//tensorflow/compiler/mlir/tensorflow:dump_graph_test', '//tensorflow/core/common_runtime:direct_session_test', '//tensorflow/core/common_runtime:direct_session_with_debug_test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:quantize_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python:quantized_ops_test', '//tensorflow/python:script_ops_test', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}})
skipping: [localhost] => (item={'key': '2.7', 'value': {'tensorflow_version': '2.7.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.5', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.7.0', 'tensorboard_version': '==2.7.0', 'tensorflow_estimator_version': '==2.7.0', 'image_prefix': '', 'python_install_packages': ['portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/java/...', '//tensorflow/lite/...', '//tensorflow/compiler/xla/python/...', '//tensorflow/compiler/xla/service/cpu/...', '//tensorflow/compiler/xla/tests/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/core/kernels:sparse_matmul_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/debug/cli:debugger_cli_common_test', '//tensorflow/python/debug/examples/v2:examples_v2_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/keras/mixed_precision:model_test', '//tensorflow/python/keras/preprocessing:image_test', '//tensorflow/python/kernel_tests:init_ops_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests:self_adjoint_eig_op_test', '//tensorflow/python/kernel_tests:sparse_matmul_op_test', '//tensorflow/python/lib/io:file_io_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python/ops/ragged:ragged_print_op_test', '//tensorflow/python/profiler/integration_test:profiler_api_test', '//tensorflow/python/profiler:profiler_v2_test', '//tensorflow/python/util:dispatch_test', '//tensorflow/python/util:traceback_utils_test', '//tensorflow/tools/api/tests:api_compatibility_test', '//tensorflow/tools/docs:tf_doctest', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}})
skipping: [localhost] => (item={'key': '2.6', 'value': {'tensorflow_version': '2.6.5', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.6.0', 'tensorboard_version': '==2.6.0', 'tensorflow_estimator_version': '==2.6.0', 'image_prefix': '', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}})
skipping: [localhost] => (item={'key': '2.5', 'value': {'tensorflow_version': '2.5.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.34.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.5.0', 'tensorboard_version': '==2.5.0', 'tensorflow_estimator_version': '==2.5.0', 'image_prefix': '', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}})
skipping: [localhost] => (item={'key': '2.4', 'value': {'tensorflow_version': '2.4.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.3.3', 'grpcio_version': '~=1.32.0', 'h5py_version': '~=2.10', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.4.3', 'tensorboard_version': '==2.4.1', 'tensorflow_estimator_version': '==2.4.0', 'image_prefix': '', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}})
skipping: [localhost] => (item={'key': '1.15', 'value': {'tensorflow_version': '1.15.5', 'bazel_version': '0.29.1', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.2.2', 'grpcio_version': '~=1.32.0', 'h5py_version': '==2.10', 'numpy_version': '~=1.18.0', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==1.2.2', 'tensorboard_version': '==1.15.0', 'tensorflow_estimator_version': '==1.15.2', 'image_prefix': '', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m']}})
TASK [tensorflow : Set TensorFlow and other package versions] ******************
Thursday 02 March 2023 18:10:09 +0000 (0:00:00.263) 0:00:04.670 ********
ok: [localhost]
TASK [tensorflow : Set build dir for TensorFlow git] ***************************
Thursday 02 March 2023 18:10:09 +0000 (0:00:00.087) 0:00:04.758 ********
ok: [localhost]
TASK [tensorflow : Remove TensorFlow git sources from previous build] **********
Thursday 02 March 2023 18:10:09 +0000 (0:00:00.046) 0:00:04.805 ********
fatal: [localhost]: FAILED! => changed=false
msg: 'rmtree failed: [Errno 13] Permission denied: ''tf_ci_cpu-2.13.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl'''
PLAY RECAP *********************************************************************
localhost : ok=6 changed=2 unreachable=0 failed=1 skipped=0 rescued=0 ignored=0
Thursday 02 March 2023 18:10:12 +0000 (0:00:02.868) 0:00:07.673 ********
===============================================================================
tensorflow : Remove TensorFlow git sources from previous build ---------- 2.87s
Gathering Facts --------------------------------------------------------- 1.64s
Create cache dirs ------------------------------------------------------- 1.38s
Cleanup after previous build -------------------------------------------- 1.28s
Go through each TensorFlow version -------------------------------------- 0.26s
tensorflow : Set TensorFlow and other package versions ------------------ 0.09s
tensorflow : Set build dir for TensorFlow git --------------------------- 0.05s
Set dual abi variable --------------------------------------------------- 0.04s
Build step 'Execute shell' marked build as failure
3 weeks, 1 day
- 1
- 3
Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #706
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/706/disp…>
Changes:
------------------------------------------
[...truncated 8.17 KB...]
skipping: [localhost] => (item={'key': '2.8', 'value': {'tensorflow_version': '2.8.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.8.0', 'tensorboard_version': '==2.8.0', 'tensorflow_estimator_version': '==2.8.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/mlir/lite/tests:prepare-tf.mlir.test', '//tensorflow/compiler/mlir/tensorflow:dump_graph_test', '//tensorflow/core/common_runtime:direct_session_test', '//tensorflow/core/common_runtime:direct_session_with_debug_test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:quantize_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python:quantized_ops_test', '//tensorflow/python:script_ops_test', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}})
skipping: [localhost] => (item={'key': '2.7', 'value': {'tensorflow_version': '2.7.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.5', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.7.0', 'tensorboard_version': '==2.7.0', 'tensorflow_estimator_version': '==2.7.0', 'python_install_packages': ['portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/java/...', '//tensorflow/lite/...', '//tensorflow/compiler/xla/python/...', '//tensorflow/compiler/xla/service/cpu/...', '//tensorflow/compiler/xla/tests/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/core/kernels:sparse_matmul_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/debug/cli:debugger_cli_common_test', '//tensorflow/python/debug/examples/v2:examples_v2_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/keras/mixed_precision:model_test', '//tensorflow/python/keras/preprocessing:image_test', '//tensorflow/python/kernel_tests:init_ops_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests:self_adjoint_eig_op_test', '//tensorflow/python/kernel_tests:sparse_matmul_op_test', '//tensorflow/python/lib/io:file_io_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python/ops/ragged:ragged_print_op_test', '//tensorflow/python/profiler/integration_test:profiler_api_test', '//tensorflow/python/profiler:profiler_v2_test', '//tensorflow/python/util:dispatch_test', '//tensorflow/python/util:traceback_utils_test', '//tensorflow/tools/api/tests:api_compatibility_test', '//tensorflow/tools/docs:tf_doctest', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}})
skipping: [localhost] => (item={'key': '2.6', 'value': {'tensorflow_version': '2.6.5', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.6.0', 'tensorboard_version': '==2.6.0', 'tensorflow_estimator_version': '==2.6.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}})
skipping: [localhost] => (item={'key': '2.5', 'value': {'tensorflow_version': '2.5.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.34.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.5.0', 'tensorboard_version': '==2.5.0', 'tensorflow_estimator_version': '==2.5.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}})
skipping: [localhost] => (item={'key': '2.4', 'value': {'tensorflow_version': '2.4.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.3.3', 'grpcio_version': '~=1.32.0', 'h5py_version': '~=2.10', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.4.3', 'tensorboard_version': '==2.4.1', 'tensorflow_estimator_version': '==2.4.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}})
skipping: [localhost] => (item={'key': '1.15', 'value': {'tensorflow_version': '1.15.5', 'bazel_version': '0.29.1', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.2.2', 'grpcio_version': '~=1.32.0', 'h5py_version': '==2.10', 'numpy_version': '~=1.18.0', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==1.2.2', 'tensorboard_version': '==1.15.0', 'tensorflow_estimator_version': '==1.15.2', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m']}})
TASK [tensorflow : Set TensorFlow and other package versions] ******************
Monday 27 February 2023 18:10:09 +0000 (0:00:00.257) 0:00:04.710 *******
ok: [localhost]
TASK [tensorflow : Set build dir for TensorFlow git] ***************************
Monday 27 February 2023 18:10:09 +0000 (0:00:00.083) 0:00:04.793 *******
ok: [localhost]
TASK [tensorflow : Remove TensorFlow git sources from previous build] **********
Monday 27 February 2023 18:10:09 +0000 (0:00:00.047) 0:00:04.841 *******
changed: [localhost]
TASK [tensorflow : Fetch TensorFlow] *******************************************
Monday 27 February 2023 18:10:13 +0000 (0:00:03.861) 0:00:08.702 *******
included: <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/confi…> for localhost
TASK [tensorflow : Fetch TensorFlow git source] ********************************
Monday 27 February 2023 18:10:13 +0000 (0:00:00.116) 0:00:08.819 *******
skipping: [localhost]
TASK [tensorflow : Unpack TensorFlow git source] *******************************
Monday 27 February 2023 18:10:13 +0000 (0:00:00.039) 0:00:08.859 *******
skipping: [localhost]
TASK [tensorflow : Rename source dir for oneDNN build] *************************
Monday 27 February 2023 18:10:13 +0000 (0:00:00.038) 0:00:08.897 *******
skipping: [localhost]
TASK [tensorflow : Fetch TensorFlow from git] **********************************
Monday 27 February 2023 18:10:13 +0000 (0:00:00.038) 0:00:08.936 *******
changed: [localhost]
TASK [tensorflow : Fetch TensorFlow from git at commit] ************************
Monday 27 February 2023 18:10:36 +0000 (0:00:22.770) 0:00:31.706 *******
skipping: [localhost]
TASK [tensorflow : Set world write access to source] ***************************
Monday 27 February 2023 18:10:36 +0000 (0:00:00.036) 0:00:31.743 *******
changed: [localhost]
TASK [tensorflow : Get oneline version of git log for this checkout] ***********
Monday 27 February 2023 18:10:36 +0000 (0:00:00.375) 0:00:32.118 *******
changed: [localhost]
TASK [tensorflow : Show git log] ***********************************************
Monday 27 February 2023 18:10:37 +0000 (0:00:00.605) 0:00:32.724 *******
ok: [localhost] =>
git_log.stdout: 62a793ae3214ea6fdc41d780802b4c49d0270be1 Make inferReturnTypeComponentsFromOperands more resilient against cast failures.
TASK [tensorflow : Record git commit hash to variable] *************************
Monday 27 February 2023 18:10:37 +0000 (0:00:00.044) 0:00:32.768 *******
ok: [localhost]
TASK [tensorflow : Save git commit hash to file] *******************************
Monday 27 February 2023 18:10:37 +0000 (0:00:00.064) 0:00:32.833 *******
changed: [localhost]
TASK [Build Bazel] *************************************************************
Monday 27 February 2023 18:10:38 +0000 (0:00:01.113) 0:00:33.947 *******
skipping: [localhost]
TASK [Build TensorFlow for each Python version] ********************************
Monday 27 February 2023 18:10:38 +0000 (0:00:00.036) 0:00:33.983 *******
skipping: [localhost] => (item=3.8)
skipping: [localhost] => (item=3.9)
skipping: [localhost] => (item=3.10)
skipping: [localhost] => (item=3.11)
TASK [Build TensorFlow for each Python version (dual abi)] *********************
Monday 27 February 2023 18:10:38 +0000 (0:00:00.056) 0:00:34.040 *******
TASK [tensorflow_in_container : Reset checkout to clean state] *****************
Monday 27 February 2023 18:10:39 +0000 (0:00:00.654) 0:00:34.694 *******
changed: [localhost]
TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] ***
Monday 27 February 2023 18:10:40 +0000 (0:00:00.627) 0:00:35.322 *******
skipping: [localhost]
TASK [Fetch TensorFlow] ********************************************************
Monday 27 February 2023 18:10:40 +0000 (0:00:00.037) 0:00:35.359 *******
skipping: [localhost]
TASK [(Python 3.8) patch TensorFlow tree] **************************************
Monday 27 February 2023 18:10:40 +0000 (0:00:00.038) 0:00:35.398 *******
TASK [tensorflow : Create linklibs shell script] *******************************
Monday 27 February 2023 18:10:40 +0000 (0:00:00.151) 0:00:35.550 *******
changed: [localhost]
TASK [tensorflow : Create readme file about unit tests] ************************
Monday 27 February 2023 18:10:41 +0000 (0:00:00.693) 0:00:36.243 *******
changed: [localhost]
TASK [tensorflow : Add to the copied files] ************************************
Monday 27 February 2023 18:10:41 +0000 (0:00:00.704) 0:00:36.947 *******
changed: [localhost]
TASK [tensorflow : Add to the long_description in setup.py] ********************
Monday 27 February 2023 18:10:42 +0000 (0:00:00.561) 0:00:37.509 *******
changed: [localhost]
TASK [tensorflow : Use nightly package requirements] ***************************
Monday 27 February 2023 18:10:42 +0000 (0:00:00.552) 0:00:38.061 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) copy upper constraints] ***********
Monday 27 February 2023 18:10:43 +0000 (0:00:00.392) 0:00:38.454 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) copy upper-constraints to within Docker context] ***
Monday 27 February 2023 18:10:44 +0000 (0:00:00.769) 0:00:39.223 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) build Python versioned container] ***
Monday 27 February 2023 18:10:44 +0000 (0:00:00.367) 0:00:39.591 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) start build container] ************
Monday 27 February 2023 18:11:27 +0000 (0:00:43.096) 0:01:22.687 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir] ***
Monday 27 February 2023 18:11:29 +0000 (0:00:01.948) 0:01:24.636 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) create link for bazel cache] ******
Monday 27 February 2023 18:11:30 +0000 (0:00:01.194) 0:01:25.830 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) create link for bazelisk cache] ***
Monday 27 February 2023 18:11:31 +0000 (0:00:00.828) 0:01:26.659 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) create link for pip cache] ********
Monday 27 February 2023 18:11:32 +0000 (0:00:00.832) 0:01:27.492 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) build TensorFlow git] *************
Monday 27 February 2023 18:11:33 +0000 (0:00:00.884) 0:01:28.376 *******
fatal: [localhost]: FAILED! => changed=true
rc: 1
stderr: |-
Extracting Bazel installation...
Starting local Bazel server and connecting to it...
INFO: Invocation ID: 67033efc-3ee3-4d84-ad37-0241d975ccb5
INFO: Options provided by the client:
Inherited 'common' options: --isatty=0 --terminal_columns=80
INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc:
Inherited 'common' options: --experimental_repo_remote_exec
INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc:
'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils
INFO: Reading rc options for 'build' from /usertools/aarch64.bazelrc:
'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/local/bin/python3 --python_path=/usr/local/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --distinct_host_configuration=false --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3
INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING
INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64.bazelrc: --disk_cache=/tf/cache
INFO: Found applicable config definition build:ambe in file /usertools/aarch64.bazelrc: --distinct_host_configuration=false --flaky_test_attempts=3 --action_env=PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin --host_crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --extra_toolchains=@ml2014_aarch64_config_aarch64//crosstool:toolchain-linux-aarch64 --extra_execution_platforms=@ml2014_aarch64_config_aarch64_platform//:platform --host_platform=@ml2014_aarch64_config_aarch64_platform//:platform --platforms=@ml2014_aarch64_config_aarch64_platform//:platform --repo_env=TF_PYTHON_CONFIG_REPO=@ml2014_aarch64_config_python
INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes
INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS
Loading:
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
currently loading: tensorflow/tools/pip_package
Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured)
Analyzing: target //tensorflow/tools/pip_package:build_pip_package (286 packages loaded, 4248 targets configured)
Analyzing: target //tensorflow/tools/pip_package:build_pip_package (590 packages loaded, 32772 targets configured)
INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (590 packages loaded, 33790 targets configured).
INFO: Found 1 target...
[0 / 101] [Prepa] Creating source manifest for //tensorflow/lite/tools:visualize ... (17 actions, 0 running)
[7,348 / 17,715] Compiling tensorflow/tsl/platform/protobuf_util.cc; 6s local, remote-cache ... (111 actions, 110 running)
[9,698 / 21,273] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 14s local, remote-cache ... (110 actions, 109 running)
[11,721 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 23s local, remote-cache ... (111 actions, 110 running)
[11,796 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 35s local, remote-cache ... (111 actions, 110 running)
[12,263 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 48s local, remote-cache ... (111 actions, 110 running)
[12,509 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 63s local, remote-cache ... (109 actions, 108 running)
[12,757 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 80s local, remote-cache ... (111 actions, 110 running)
[13,045 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 100s local, remote-cache ... (111 actions, 110 running)
[13,200 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 123s local, remote-cache ... (109 actions, 108 running)
[13,369 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 150s local, remote-cache ... (111 actions, 110 running)
[13,613 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 180s local, remote-cache ... (111 actions, 110 running)
[13,807 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 215s local, remote-cache ... (111 actions, 110 running)
[14,086 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 255s local, remote-cache ... (111 actions, 110 running)
[14,441 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 302s local, remote-cache ... (111 actions, 110 running)
[14,792 / 21,430] Compiling tensorflow/core/util/batch_util.cc; 68s local, remote-cache ... (111 actions, 110 running)
[15,172 / 21,430] Compiling tensorflow/core/kernels/rnn/lstm_ops.cc; 50s local, remote-cache ... (111 actions, 110 running)
[15,584 / 21,430] Compiling tensorflow/core/kernels/padding_fifo_queue.cc; 82s local, remote-cache ... (111 actions, 110 running)
[17,984 / 21,430] Compiling tensorflow/core/kernels/training_ops.cc; 112s local, remote-cache ... (111 actions, 110 running)
[18,792 / 21,430] Compiling tensorflow/core/kernels/training_ops.cc; 205s local, remote-cache ... (111 actions, 110 running)
[19,002 / 21,430] Compiling tensorflow/compiler/xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 167s local, remote-cache ... (111 actions, 110 running)
[19,189 / 21,430] Compiling tensorflow/core/kernels/argmax_op.cc; 250s local, remote-cache ... (112 actions running)
[19,633 / 21,430] Compiling tensorflow/core/kernels/matmul_op_real.cc; 387s local, remote-cache ... (112 actions running)
ERROR: /tf/tensorflow/tensorflow/compiler/mlir/quantization/tensorflow/BUILD:272:11: Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/tf_quant_ops.cc failed: (Exit 1): gcc failed: error executing command /dt10/usr/bin/gcc -MD -MF bazel-out/aarch64-opt/bin/tensorflow/compiler/mlir/quantization/tensorflow/_objs/tf_quant_ops/tf_quant_ops.pic.d ... (remaining 213 arguments skipped)
In file included from ./tensorflow/compiler/mlir/quantization/tensorflow/passes/tf_quant_ops.h:36,
from tensorflow/compiler/mlir/quantization/tensorflow/passes/tf_quant_ops.cc:15:
./tensorflow/compiler/mlir/tensorflow/ir/tf_traits.h: In static member function 'static mlir::LogicalResult mlir::OpTrait::TF::SameOperandsAndResultTypeResolveRef<ConcreteType>::inferReturnTypeComponentsFromOperands(mlir::MLIRContext*, std::optional<mlir::Location>, mlir::ValueShapeRange, mlir::DictionaryAttr, mlir::RegionRange, llvm::SmallVectorImpl<mlir::ShapedTypeComponents>&)':
./tensorflow/compiler/mlir/tensorflow/ir/tf_traits.h:167:55: error: expected primary-expression before '>' token
167 | auto shape_type = ty.dyn_cast_or_null<ShapedType>();
| ^
./tensorflow/compiler/mlir/tensorflow/ir/tf_traits.h:167:57: error: expected primary-expression before ')' token
167 | auto shape_type = ty.dyn_cast_or_null<ShapedType>();
| ^
Target //tensorflow/tools/pip_package:build_pip_package failed to build
Use --verbose_failures to see the command lines of failed build steps.
INFO: Elapsed time: 1101.906s, Critical Path: 394.52s
INFO: 19709 processes: 11497 disk cache hit, 5109 internal, 3103 local.
FAILED: Build did NOT complete successfully
FAILED: Build did NOT complete successfully
stderr_lines: <omitted>
stdout: ''
stdout_lines: <omitted>
PLAY RECAP *********************************************************************
localhost : ok=28 changed=21 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0
Monday 27 February 2023 18:29:56 +0000 (0:18:22.935) 0:19:51.312 *******
===============================================================================
tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 1102.94s
tensorflow_in_container : (Python 3.8) build Python versioned container -- 43.10s
tensorflow : Fetch TensorFlow from git --------------------------------- 22.77s
tensorflow : Remove TensorFlow git sources from previous build ---------- 3.86s
tensorflow_in_container : (Python 3.8) start build container ------------ 1.95s
Gathering Facts --------------------------------------------------------- 1.67s
Create cache dirs ------------------------------------------------------- 1.38s
Cleanup after previous build -------------------------------------------- 1.28s
tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.19s
tensorflow : Save git commit hash to file ------------------------------- 1.11s
tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.88s
tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.83s
tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.83s
tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.77s
tensorflow : Create readme file about unit tests ------------------------ 0.70s
tensorflow : Create linklibs shell script ------------------------------- 0.69s
Build TensorFlow for each Python version (dual abi) --------------------- 0.65s
tensorflow_in_container : Reset checkout to clean state ----------------- 0.63s
tensorflow : Get oneline version of git log for this checkout ----------- 0.61s
tensorflow : Add to the copied files ------------------------------------ 0.56s
Build step 'Execute shell' marked build as failure
3 weeks, 4 days
- 1
- 1
Build failed in Jenkins: Tensorflow oneDNN Python package (manylinux2014 nightly) #349
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/3…>
Changes:
------------------------------------------
[...truncated 16.71 KB...]
TASK [tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build] ***
Friday 24 February 2023 01:56:10 +0000 (0:00:00.044) 0:00:05.786 *******
changed: [localhost]
TASK [tensorflow : Fetch TensorFlow] *******************************************
Friday 24 February 2023 01:56:13 +0000 (0:00:03.453) 0:00:09.239 *******
included: <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/w…> for localhost
TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL git source] *********************
Friday 24 February 2023 01:56:13 +0000 (0:00:00.115) 0:00:09.354 *******
skipping: [localhost]
TASK [tensorflow : Unpack TensorFlow-oneDNN-ACL git source] ********************
Friday 24 February 2023 01:56:13 +0000 (0:00:00.040) 0:00:09.395 *******
skipping: [localhost]
TASK [tensorflow : Rename source dir for oneDNN build] *************************
Friday 24 February 2023 01:56:13 +0000 (0:00:00.037) 0:00:09.432 *******
skipping: [localhost]
TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL from git] ***********************
Friday 24 February 2023 01:56:13 +0000 (0:00:00.038) 0:00:09.471 *******
changed: [localhost]
TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL from git at commit] *************
Friday 24 February 2023 01:56:35 +0000 (0:00:21.968) 0:00:31.440 *******
skipping: [localhost]
TASK [tensorflow : Set world write access to source] ***************************
Friday 24 February 2023 01:56:35 +0000 (0:00:00.036) 0:00:31.477 *******
changed: [localhost]
TASK [tensorflow : Get oneline version of git log for this checkout] ***********
Friday 24 February 2023 01:56:36 +0000 (0:00:00.374) 0:00:31.852 *******
changed: [localhost]
TASK [tensorflow : Show git log] ***********************************************
Friday 24 February 2023 01:56:36 +0000 (0:00:00.585) 0:00:32.438 *******
ok: [localhost] =>
git_log.stdout: 3f43b4eb7c183b3ce077dbee5b06c1b1ac201d72 Support quantizing models that use asset files to initialize resources.
TASK [tensorflow : Record git commit hash to variable] *************************
Friday 24 February 2023 01:56:36 +0000 (0:00:00.044) 0:00:32.482 *******
ok: [localhost]
TASK [tensorflow : Save git commit hash to file] *******************************
Friday 24 February 2023 01:56:36 +0000 (0:00:00.062) 0:00:32.544 *******
changed: [localhost]
TASK [Build Bazel] *************************************************************
Friday 24 February 2023 01:56:38 +0000 (0:00:01.146) 0:00:33.691 *******
skipping: [localhost]
TASK [Build TensorFlow for each Python version] ********************************
Friday 24 February 2023 01:56:38 +0000 (0:00:00.059) 0:00:33.751 *******
skipping: [localhost] => (item=3.8)
skipping: [localhost] => (item=3.9)
skipping: [localhost] => (item=3.10)
skipping: [localhost] => (item=3.11)
TASK [Build TensorFlow for each Python version (dual abi)] *********************
Friday 24 February 2023 01:56:38 +0000 (0:00:00.055) 0:00:33.807 *******
TASK [tensorflow_in_container : Reset checkout to clean state] *****************
Friday 24 February 2023 01:56:38 +0000 (0:00:00.632) 0:00:34.439 *******
changed: [localhost]
TASK [tensorflow_in_container : Remove TensorFlow-oneDNN-ACL git sources from previous build] ***
Friday 24 February 2023 01:56:39 +0000 (0:00:00.828) 0:00:35.268 *******
skipping: [localhost]
TASK [Fetch TensorFlow] ********************************************************
Friday 24 February 2023 01:56:39 +0000 (0:00:00.037) 0:00:35.306 *******
skipping: [localhost]
TASK [(Python 3.8) patch TensorFlow tree] **************************************
Friday 24 February 2023 01:56:39 +0000 (0:00:00.037) 0:00:35.344 *******
TASK [tensorflow : Create linklibs shell script] *******************************
Friday 24 February 2023 01:56:39 +0000 (0:00:00.172) 0:00:35.516 *******
changed: [localhost]
TASK [tensorflow : Create readme file about unit tests] ************************
Friday 24 February 2023 01:56:40 +0000 (0:00:00.692) 0:00:36.209 *******
changed: [localhost]
TASK [tensorflow : Add to the copied files] ************************************
Friday 24 February 2023 01:56:41 +0000 (0:00:00.700) 0:00:36.909 *******
changed: [localhost]
TASK [tensorflow : Add to the long_description in setup.py] ********************
Friday 24 February 2023 01:56:41 +0000 (0:00:00.596) 0:00:37.506 *******
changed: [localhost]
TASK [tensorflow : Use nightly package requirements] ***************************
Friday 24 February 2023 01:56:42 +0000 (0:00:00.581) 0:00:38.088 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) start build container] ************
Friday 24 February 2023 01:56:42 +0000 (0:00:00.392) 0:00:38.480 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir] ***
Friday 24 February 2023 01:57:18 +0000 (0:00:35.153) 0:01:13.634 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) create link for bazel cache] ******
Friday 24 February 2023 01:57:19 +0000 (0:00:01.227) 0:01:14.862 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) create link for bazelisk cache] ***
Friday 24 February 2023 01:57:20 +0000 (0:00:00.814) 0:01:15.677 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) create link for pip cache] ********
Friday 24 February 2023 01:57:20 +0000 (0:00:00.822) 0:01:16.499 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) copy upper constraints] ***********
Friday 24 February 2023 01:57:21 +0000 (0:00:00.788) 0:01:17.288 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) install Python packages] **********
Friday 24 February 2023 01:57:22 +0000 (0:00:00.718) 0:01:18.006 *******
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git] ***
Friday 24 February 2023 01:57:54 +0000 (0:00:31.677) 0:01:49.683 *******
fatal: [localhost]: FAILED! => changed=true
rc: 1
stderr: |-
Extracting Bazel installation...
Starting local Bazel server and connecting to it...
INFO: Invocation ID: 8c55d19e-948a-4502-964f-50a104c0c7bf
INFO: Options provided by the client:
Inherited 'common' options: --isatty=0 --terminal_columns=80
INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc:
Inherited 'common' options: --experimental_repo_remote_exec
INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc:
'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils
INFO: Reading rc options for 'build' from /usertools/aarch64.bazelrc:
'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/bin/python3 --action_env PYTHON_LIB_PATH=/usr/lib/tf_python --python_path=/usr/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --distinct_host_configuration=false --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3
INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING
INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64.bazelrc: --disk_cache=/tf/cache
INFO: Found applicable config definition build:ambe in file /usertools/aarch64.bazelrc: --distinct_host_configuration=false --flaky_test_attempts=3 --action_env=PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin --host_crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --extra_toolchains=@ml2014_aarch64_config_aarch64//crosstool:toolchain-linux-aarch64 --extra_execution_platforms=@ml2014_aarch64_config_aarch64_platform//:platform --host_platform=@ml2014_aarch64_config_aarch64_platform//:platform --platforms=@ml2014_aarch64_config_aarch64_platform//:platform --repo_env=TF_PYTHON_CONFIG_REPO=@ml2014_aarch64_config_python
INFO: Found applicable config definition build:mkl_aarch64_threadpool in file /tf/tensorflow/.bazelrc: --define=build_with_mkl_aarch64=true -c opt
INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes
INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS
Loading:
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/tensorflow/… failed: class java.io.FileNotFoundException GET returned 404 Not Found
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-p… failed: class java.io.FileNotFoundException GET returned 404 Not Found
Loading: 0 packages loaded
Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured)
WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/openxla/sta… failed: class java.io.FileNotFoundException GET returned 404 Not Found
Analyzing: target //tensorflow/tools/pip_package:build_pip_package (289 packages loaded, 4306 targets configured)
INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (593 packages loaded, 37030 targets configured).
INFO: Found 1 target...
[0 / 183] [Prepa] Creating source manifest for //tensorflow/lite/python:tflite_convert ... (5 actions, 0 running)
[12,136 / 23,108] Compiling tensorflow/lite/delegates/xnnpack/quantization_util.cc; 11s local, remote-cache ... (111 actions, 110 running)
[12,210 / 23,108] Compiling tensorflow/compiler/xla/literal_comparison.cc; 21s local, remote-cache ... (111 actions, 110 running)
[12,294 / 23,108] Compiling tensorflow/compiler/xla/literal.cc; 36s local, remote-cache ... (111 actions, 110 running)
[12,387 / 23,108] Compiling tensorflow/compiler/xla/literal.cc; 52s local, remote-cache ... (112 actions running)
[12,622 / 23,108] Compiling tensorflow/compiler/xla/hlo/ir/hlo_instruction.cc; 38s local, remote-cache ... (112 actions running)
[12,873 / 23,108] Compiling tensorflow/compiler/xla/service/memory_space_assignment.cc; 51s local, remote-cache ... (112 actions running)
[13,013 / 23,108] Compiling tensorflow/compiler/xla/service/algebraic_simplifier.cc; 63s local, remote-cache ... (112 actions running)
[13,169 / 23,108] Compiling tensorflow/python/client/tf_session_wrapper.cc; 55s local, remote-cache ... (112 actions running)
[13,383 / 23,108] Compiling tensorflow/core/kernels/rnn/lstm_ops.cc; 66s local, remote-cache ... (112 actions running)
[13,695 / 23,108] Compiling tensorflow/core/kernels/padding_fifo_queue.cc; 52s local, remote-cache ... (112 actions running)
[13,919 / 23,108] Compiling tensorflow/core/kernels/lrn_op.cc; 66s local, remote-cache ... (112 actions running)
[14,212 / 23,108] Compiling tensorflow/core/kernels/image/mirror_pad_op_cpu_impl_5.cc; 53s local, remote-cache ... (112 actions running)
[14,634 / 23,108] Compiling tensorflow/core/kernels/training_ops.cc; 64s local, remote-cache ... (112 actions running)
[17,905 / 24,452] Compiling tensorflow/core/kernels/training_ops.cc; 131s local, remote-cache ... (112 actions running)
[18,516 / 24,452] Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 42s local, remote-cache ... (112 actions running)
[18,910 / 24,452] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops.cc; 66s local, remote-cache ... (112 actions running)
[19,369 / 24,452] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops.cc; 168s local, remote-cache ... (111 actions, 110 running)
[19,627 / 24,452] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops.cc; 285s local, remote-cache ... (112 actions running)
[19,805 / 24,452] Compiling tensorflow/core/kernels/cwise_op_select.cc; 181s local, remote-cache ... (112 actions running)
[20,435 / 24,452] Compiling tensorflow/core/kernels/matmul_op_real.cc; 240s local, remote-cache ... (112 actions running)
[21,299 / 24,452] Compiling tensorflow/core/kernels/matmul_op_real.cc; 418s local, remote-cache ... (112 actions running)
[22,060 / 24,452] Compiling tensorflow/compiler/xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 135s local, remote-cache ... (112 actions running)
[22,817 / 24,452] Compiling tensorflow/dtensor/mlir/expansions/iterator_spmd_expander.cc; 40s local, remote-cache ... (112 actions running)
[24,042 / 24,484] Compiling tensorflow/dtensor/cc/dtensor_device.cc; 60s local, remote-cache ... (111 actions, 110 running)
[24,592 / 24,659] Linking tensorflow/libtensorflow_cc.so.2.13.0; 161s local, remote-cache
ERROR: /tf/tensorflow/tensorflow/BUILD:1635:19: Executing genrule //tensorflow:tf_python_api_gen_v2 failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped)
Traceback (most recent call last):
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/tools/api/generator/create_python_api.py", line 22, in <module>
from tensorflow.python.tools.api.generator import doc_srcs
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/__init__.py", line 37, in <module>
from tensorflow.python.eager import context
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/eager/context.py", line 28, in <module>
from tensorflow.core.framework import function_pb2
File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/core/framework/function_pb2.py", line 5, in <module>
from google.protobuf.internal import builder as _builder
ModuleNotFoundError: No module named 'google.protobuf'
Target //tensorflow/tools/pip_package:build_pip_package failed to build
Use --verbose_failures to see the command lines of failed build steps.
ERROR: /tf/tensorflow/tensorflow/python/tools/BUILD:282:10 Middleman _middlemen/tensorflow_Spython_Stools_Sprint_Uselective_Uregistration_Uheader-runfiles failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped)
INFO: Elapsed time: 2802.608s, Critical Path: 1106.80s
INFO: 24658 processes: 11508 disk cache hit, 5600 internal, 7550 local.
FAILED: Build did NOT complete successfully
FAILED: Build did NOT complete successfully
stderr_lines: <omitted>
stdout: ''
stdout_lines: <omitted>
PLAY RECAP *********************************************************************
localhost : ok=27 changed=20 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0
Friday 24 February 2023 02:44:37 +0000 (0:46:43.868) 0:48:33.552 *******
===============================================================================
tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git 2803.87s
tensorflow_in_container : (Python 3.8) start build container ----------- 35.15s
tensorflow_in_container : (Python 3.8) install Python packages --------- 31.68s
tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 21.97s
tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.45s
Gathering Facts --------------------------------------------------------- 2.63s
Create cache dirs ------------------------------------------------------- 1.40s
Cleanup after previous build -------------------------------------------- 1.28s
tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.23s
tensorflow : Save git commit hash to file ------------------------------- 1.15s
tensorflow_in_container : Reset checkout to clean state ----------------- 0.83s
tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.82s
tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.81s
tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.79s
tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.72s
tensorflow : Create readme file about unit tests ------------------------ 0.70s
tensorflow : Create linklibs shell script ------------------------------- 0.69s
Build TensorFlow for each Python version (dual abi) --------------------- 0.63s
tensorflow : Add to the copied files ------------------------------------ 0.60s
tensorflow : Get oneline version of git log for this checkout ----------- 0.59s
Build step 'Execute shell' marked build as failure
4 weeks
- 1
- 2
Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #703
by ci_notify＠linaro.org
See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/703/disp…>
Changes:
------------------------------------------
[...truncated 1002.74 KB...]
Stats over 20 runs: max = 5.5s, min = 2.7s, avg = 3.4s, dev = 0.7s
//tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 6.5s
Stats over 20 runs: max = 6.5s, min = 3.0s, avg = 4.7s, dev = 1.0s
//tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 11.3s
Stats over 20 runs: max = 11.3s, min = 3.1s, avg = 5.5s, dev = 1.7s
//tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 11.3s
Stats over 20 runs: max = 11.3s, min = 3.6s, avg = 5.2s, dev = 1.7s
//tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 6.2s
Stats over 20 runs: max = 6.2s, min = 5.4s, avg = 5.7s, dev = 0.2s
//tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 12.1s
Stats over 20 runs: max = 12.1s, min = 9.0s, avg = 10.6s, dev = 0.8s
//tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 9.4s
Stats over 20 runs: max = 9.4s, min = 8.2s, avg = 8.8s, dev = 0.4s
//tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 42.5s
Stats over 20 runs: max = 42.5s, min = 6.8s, avg = 15.3s, dev = 11.0s
//tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 15.4s
Stats over 20 runs: max = 15.4s, min = 9.5s, avg = 11.4s, dev = 1.8s
//tensorflow/python/kernel_tests:metrics_test PASSED in 33.0s
Stats over 20 runs: max = 33.0s, min = 4.8s, avg = 15.2s, dev = 8.2s
//tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 5.4s
Stats over 20 runs: max = 5.4s, min = 2.5s, avg = 3.2s, dev = 0.7s
//tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 12.0s
Stats over 20 runs: max = 12.0s, min = 2.4s, avg = 4.6s, dev = 2.5s
//tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 40.7s
Stats over 20 runs: max = 40.7s, min = 2.8s, avg = 12.3s, dev = 12.3s
//tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 94.0s
Stats over 20 runs: max = 94.0s, min = 23.5s, avg = 48.9s, dev = 18.6s
//tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 5.7s
Stats over 20 runs: max = 5.7s, min = 3.0s, avg = 4.3s, dev = 1.0s
//tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 13.5s
Stats over 20 runs: max = 13.5s, min = 6.3s, avg = 9.5s, dev = 2.0s
//tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 150.4s
Stats over 20 runs: max = 150.4s, min = 32.6s, avg = 82.4s, dev = 35.8s
//tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 17.8s
Stats over 20 runs: max = 17.8s, min = 3.0s, avg = 8.0s, dev = 5.0s
//tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 16.9s
Stats over 20 runs: max = 16.9s, min = 4.1s, avg = 9.9s, dev = 4.5s
//tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 16.4s
Stats over 20 runs: max = 16.4s, min = 13.6s, avg = 15.2s, dev = 0.8s
//tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 60.0s
Stats over 20 runs: max = 60.0s, min = 4.0s, avg = 24.9s, dev = 19.5s
//tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 18.1s
Stats over 20 runs: max = 18.1s, min = 2.7s, avg = 5.5s, dev = 3.4s
//tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 18.6s
Stats over 24 runs: max = 18.6s, min = 6.7s, avg = 12.2s, dev = 3.0s
//tensorflow/python/data/kernel_tests:interleave_test PASSED in 19.8s
Stats over 24 runs: max = 19.8s, min = 6.3s, avg = 12.1s, dev = 3.6s
//tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 20.2s
Stats over 24 runs: max = 20.2s, min = 6.5s, avg = 10.8s, dev = 4.1s
//tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 6.8s
Stats over 25 runs: max = 6.8s, min = 5.7s, avg = 6.0s, dev = 0.2s
//tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 33.6s
Stats over 25 runs: max = 33.6s, min = 6.8s, avg = 11.0s, dev = 6.7s
//tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 7.5s
Stats over 30 runs: max = 7.5s, min = 6.5s, avg = 7.0s, dev = 0.3s
//tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 12.2s
Stats over 30 runs: max = 12.2s, min = 10.5s, avg = 11.2s, dev = 0.4s
//tensorflow/compiler/xla/tests:params_test_cpu PASSED in 6.8s
Stats over 30 runs: max = 6.8s, min = 5.6s, avg = 6.1s, dev = 0.3s
//tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 6.6s
Stats over 30 runs: max = 6.6s, min = 5.7s, avg = 6.1s, dev = 0.2s
//tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 15.7s
Stats over 30 runs: max = 15.7s, min = 2.8s, avg = 6.3s, dev = 3.0s
//tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 7.0s
Stats over 31 runs: max = 7.0s, min = 5.9s, avg = 6.4s, dev = 0.2s
//tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 9.1s
Stats over 32 runs: max = 9.1s, min = 5.9s, avg = 6.6s, dev = 0.7s
//tensorflow/python/data/experimental/kernel_tests/service:auto_shard_test PASSED in 14.4s
Stats over 32 runs: max = 14.4s, min = 3.1s, avg = 9.0s, dev = 2.9s
//tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 26.3s
Stats over 32 runs: max = 26.3s, min = 6.7s, avg = 15.1s, dev = 4.5s
//tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 8.5s
Stats over 40 runs: max = 8.5s, min = 6.1s, avg = 7.3s, dev = 0.9s
//tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 7.6s
Stats over 40 runs: max = 7.6s, min = 5.8s, avg = 6.5s, dev = 0.4s
//tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 8.4s
Stats over 40 runs: max = 8.4s, min = 6.6s, avg = 7.5s, dev = 0.4s
//tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 9.0s
Stats over 40 runs: max = 9.0s, min = 6.2s, avg = 7.1s, dev = 0.6s
//tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 83.5s
Stats over 50 runs: max = 83.5s, min = 16.2s, avg = 36.8s, dev = 24.1s
//tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 35.8s
Stats over 50 runs: max = 35.8s, min = 2.4s, avg = 9.7s, dev = 7.4s
//tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 38.2s
Stats over 50 runs: max = 38.2s, min = 2.5s, avg = 9.3s, dev = 7.7s
//tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 9.2s
Stats over 50 runs: max = 9.2s, min = 6.2s, avg = 6.9s, dev = 0.6s
//tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 9.8s
Stats over 50 runs: max = 9.8s, min = 8.1s, avg = 8.9s, dev = 0.4s
//tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 13.2s
Stats over 50 runs: max = 13.2s, min = 7.9s, avg = 9.8s, dev = 1.1s
//tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 21.5s
Stats over 50 runs: max = 21.5s, min = 5.4s, avg = 10.6s, dev = 3.7s
//tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 5.6s
Stats over 50 runs: max = 5.6s, min = 2.5s, avg = 3.4s, dev = 0.8s
//tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 5.5s
Stats over 50 runs: max = 5.5s, min = 2.6s, avg = 3.1s, dev = 0.6s
//tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 29.1s
Stats over 50 runs: max = 29.1s, min = 6.4s, avg = 14.4s, dev = 5.6s
//tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 11.2s
Stats over 50 runs: max = 11.2s, min = 2.8s, avg = 3.9s, dev = 1.2s
//tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 10.1s
Stats over 50 runs: max = 10.1s, min = 2.5s, avg = 3.9s, dev = 2.0s
Executed 3602 out of 3602 tests: 3599 tests pass and 3 fail locally.
There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are.
stdout_lines: <omitted>
...ignoring
TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages] ***
Saturday 25 February 2023 11:15:05 +0000 (1:08:03.515) 2:01:48.106 *****
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) save list of installed Python packages] ***
Saturday 25 February 2023 11:15:07 +0000 (0:00:01.965) 2:01:50.072 *****
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) save tests output to file] ********
Saturday 25 February 2023 11:15:08 +0000 (0:00:00.695) 2:01:50.767 *****
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) save tests stderr output to file] ***
Saturday 25 February 2023 11:15:08 +0000 (0:00:00.708) 2:01:51.475 *****
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) Extract number of tests run] ******
Saturday 25 February 2023 11:15:09 +0000 (0:00:00.698) 2:01:52.174 *****
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.8) Show number of tests run] *********
Saturday 25 February 2023 11:15:09 +0000 (0:00:00.102) 2:01:52.276 *****
ok: [localhost] =>
ut_tests_line: ''
TASK [tensorflow_in_container : (Python 3.8) Extract failed tests] *************
Saturday 25 February 2023 11:15:09 +0000 (0:00:00.046) 2:01:52.323 *****
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.8) Show which tests failed] **********
Saturday 25 February 2023 11:15:09 +0000 (0:00:00.104) 2:01:52.427 *****
ok: [localhost] =>
tests_failed: 'FAILED: '
TASK [tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one] ***
Saturday 25 February 2023 11:15:09 +0000 (0:00:00.048) 2:01:52.476 *****
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) Get list of wheel files] **********
Saturday 25 February 2023 11:22:45 +0000 (0:07:35.971) 2:09:28.447 *****
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.8) Get filename of latest wheel] *****
Saturday 25 February 2023 11:22:46 +0000 (0:00:00.602) 2:09:29.050 *****
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.8) move manylinux2014 wheel outside] ***
Saturday 25 February 2023 11:22:46 +0000 (0:00:00.067) 2:09:29.118 *****
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) Remove manylinux2014 wheel] *******
Saturday 25 February 2023 11:22:48 +0000 (0:00:02.368) 2:09:31.486 *****
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) stop build container] *************
Saturday 25 February 2023 11:22:49 +0000 (0:00:00.422) 2:09:31.908 *****
changed: [localhost]
TASK [tensorflow_in_container : Reset checkout to clean state] *****************
Saturday 25 February 2023 11:26:25 +0000 (0:03:35.878) 2:13:07.787 *****
changed: [localhost]
TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] ***
Saturday 25 February 2023 11:26:25 +0000 (0:00:00.639) 2:13:08.426 *****
skipping: [localhost]
TASK [Fetch TensorFlow] ********************************************************
Saturday 25 February 2023 11:26:25 +0000 (0:00:00.039) 2:13:08.466 *****
skipping: [localhost]
TASK [(Python 3.9) patch TensorFlow tree] **************************************
Saturday 25 February 2023 11:26:25 +0000 (0:00:00.039) 2:13:08.506 *****
TASK [tensorflow : Create linklibs shell script] *******************************
Saturday 25 February 2023 11:26:26 +0000 (0:00:00.176) 2:13:08.682 *****
changed: [localhost]
TASK [tensorflow : Create readme file about unit tests] ************************
Saturday 25 February 2023 11:26:26 +0000 (0:00:00.699) 2:13:09.381 *****
changed: [localhost]
TASK [tensorflow : Add to the copied files] ************************************
Saturday 25 February 2023 11:26:27 +0000 (0:00:00.703) 2:13:10.085 *****
changed: [localhost]
TASK [tensorflow : Add to the long_description in setup.py] ********************
Saturday 25 February 2023 11:26:27 +0000 (0:00:00.370) 2:13:10.455 *****
changed: [localhost]
TASK [tensorflow : Use nightly package requirements] ***************************
Saturday 25 February 2023 11:26:28 +0000 (0:00:00.364) 2:13:10.820 *****
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper constraints] ***********
Saturday 25 February 2023 11:26:28 +0000 (0:00:00.395) 2:13:11.215 *****
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper-constraints to within Docker context] ***
Saturday 25 February 2023 11:26:29 +0000 (0:00:00.764) 2:13:11.979 *****
fatal: [localhost]: FAILED! => changed=true
cmd:
- cp
- <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/wheel…>
- <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/confi…>
delta: '0:00:00.003706'
end: '2023-02-25 11:26:29.715211'
msg: non-zero return code
rc: 1
start: '2023-02-25 11:26:29.711505'
stderr: 'cp: cannot create regular file ''<https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/confi…''>: Permission denied'
stderr_lines: <omitted>
stdout: ''
stdout_lines: <omitted>
PLAY RECAP *********************************************************************
localhost : ok=54 changed=40 unreachable=0 failed=1 skipped=10 rescued=0 ignored=1
Saturday 25 February 2023 11:26:29 +0000 (0:00:00.344) 2:13:12.324 *****
===============================================================================
tensorflow_in_container : (Python 3.8) run TensorFlow git tests ------ 4083.52s
tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 3038.86s
tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one - 455.97s
tensorflow_in_container : (Python 3.8) stop build container ----------- 215.88s
tensorflow_in_container : (Python 3.8) build Python package ------------ 96.26s
tensorflow_in_container : (Python 3.8) build Python versioned container -- 42.89s
tensorflow : Fetch TensorFlow from git --------------------------------- 21.49s
tensorflow : Remove TensorFlow git sources from previous build ---------- 3.79s
Gathering Facts --------------------------------------------------------- 2.62s
tensorflow_in_container : (Python 3.8) move manylinux2014 wheel outside --- 2.37s
tensorflow_in_container : (Python 3.8) collect list of installed Python packages --- 1.97s
tensorflow_in_container : (Python 3.8) start build container ------------ 1.93s
tensorflow : Create readme file about unit tests ------------------------ 1.41s
Create cache dirs ------------------------------------------------------- 1.40s
tensorflow : Create linklibs shell script ------------------------------- 1.39s
Cleanup after previous build -------------------------------------------- 1.28s
tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.26s
tensorflow : Save git commit hash to file ------------------------------- 1.12s
tensorflow : Add to the copied files ------------------------------------ 0.93s
tensorflow : Add to the long_description in setup.py -------------------- 0.92s
Build step 'Execute shell' marked build as failure
4 weeks
- 1
- 1