- ldcg-ai-ml - op-lists.linaro.org

Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #737

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/737/disp…> Changes: ------------------------------------------ [...truncated 168.51 KB...] stderr_lines: <omitted> stdout: |- ==================== Test output for //tensorflow/core/util/tensor_bundle:tensor_bundle_test: [==========] Running 18 tests from 2 test suites. [----------] Global test environment set-up. [----------] 17 tests from TensorBundleTest [ RUN ] TensorBundleTest.SwapBytes [ OK ] TensorBundleTest.SwapBytes (0 ms) [ RUN ] TensorBundleTest.Basic [ OK ] TensorBundleTest.Basic (120 ms) [ RUN ] TensorBundleTest.Endianness [ OK ] TensorBundleTest.Endianness (213 ms) [ RUN ] TensorBundleTest.PartitionedVariables [ OK ] TensorBundleTest.PartitionedVariables (2 ms) [ RUN ] TensorBundleTest.EquivalentSliceTest [ OK ] TensorBundleTest.EquivalentSliceTest (2 ms) [ RUN ] TensorBundleTest.NonStandardShapes [ OK ] TensorBundleTest.NonStandardShapes (32 ms) [ RUN ] TensorBundleTest.StringTensorsOldFormat [ OK ] TensorBundleTest.StringTensorsOldFormat (0 ms) [ RUN ] TensorBundleTest.StringTensors tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:765: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (writer.Add("long_scalar", long_string_tensor)) Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate11559948317783239214; No space left on device tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:768: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (writer.Add("floats", Constant_2x3<float>(16.18))) Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate11559948317783239214; No space left on device tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:769: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (writer.Finish()) Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate11559948317783239214; No space left on device [ FAILED ] TensorBundleTest.StringTensors (47214 ms) [ RUN ] TensorBundleTest.VariantTensors [ OK ] TensorBundleTest.VariantTensors (3 ms) [ RUN ] TensorBundleTest.DirectoryStructure [ OK ] TensorBundleTest.DirectoryStructure (6 ms) [ RUN ] TensorBundleTest.SortForSequentialAccess [ OK ] TensorBundleTest.SortForSequentialAccess (5 ms) [ RUN ] TensorBundleTest.Error [ OK ] TensorBundleTest.Error (4 ms) [ RUN ] TensorBundleTest.Checksum [ OK ] TensorBundleTest.Checksum (88 ms) [ RUN ] TensorBundleTest.TruncatedTensorContents [ OK ] TensorBundleTest.TruncatedTensorContents (31 ms) [ RUN ] TensorBundleTest.HeaderEntry [ OK ] TensorBundleTest.HeaderEntry (2 ms) [ RUN ] TensorBundleTest.VersionTest [ OK ] TensorBundleTest.VersionTest (38 ms) [ RUN ] TensorBundleTest.LargeVariableLoadingTest [ OK ] TensorBundleTest.LargeVariableLoadingTest (4 ms) [----------] 17 tests from TensorBundleTest (47772 ms total) [----------] 1 test from TensorBundleAlignmentTest [ RUN ] TensorBundleAlignmentTest.AlignmentTest [ OK ] TensorBundleAlignmentTest.AlignmentTest (2 ms) [----------] 1 test from TensorBundleAlignmentTest (2 ms total) [----------] Global test environment tear-down [==========] 18 tests from 2 test suites ran. (47775 ms total) [ PASSED ] 17 tests. [ FAILED ] 1 test, listed below: [ FAILED ] TensorBundleTest.StringTensors 1 FAILED TEST ================================================================================ ==================== Test output for //tensorflow/core/util/tensor_bundle:tensor_bundle_test: [==========] Running 18 tests from 2 test suites. [----------] Global test environment set-up. [----------] 17 tests from TensorBundleTest [ RUN ] TensorBundleTest.SwapBytes [ OK ] TensorBundleTest.SwapBytes (0 ms) [ RUN ] TensorBundleTest.Basic [ OK ] TensorBundleTest.Basic (106 ms) [ RUN ] TensorBundleTest.Endianness [ OK ] TensorBundleTest.Endianness (118 ms) [ RUN ] TensorBundleTest.PartitionedVariables [ OK ] TensorBundleTest.PartitionedVariables (3 ms) [ RUN ] TensorBundleTest.EquivalentSliceTest [ OK ] TensorBundleTest.EquivalentSliceTest (2 ms) [ RUN ] TensorBundleTest.NonStandardShapes [ OK ] TensorBundleTest.NonStandardShapes (34 ms) [ RUN ] TensorBundleTest.StringTensorsOldFormat [ OK ] TensorBundleTest.StringTensorsOldFormat (0 ms) [ RUN ] TensorBundleTest.StringTensors tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:765: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (writer.Add("long_scalar", long_string_tensor)) Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate17765104588851234696; No space left on device tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:768: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (writer.Add("floats", Constant_2x3<float>(16.18))) Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate17765104588851234696; No space left on device tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:769: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (writer.Finish()) Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate17765104588851234696; No space left on device [ FAILED ] TensorBundleTest.StringTensors (26756 ms) [ RUN ] TensorBundleTest.VariantTensors [ OK ] TensorBundleTest.VariantTensors (8 ms) [ RUN ] TensorBundleTest.DirectoryStructure [ OK ] TensorBundleTest.DirectoryStructure (9 ms) [ RUN ] TensorBundleTest.SortForSequentialAccess [ OK ] TensorBundleTest.SortForSequentialAccess (6 ms) [ RUN ] TensorBundleTest.Error [ OK ] TensorBundleTest.Error (4 ms) [ RUN ] TensorBundleTest.Checksum [ OK ] TensorBundleTest.Checksum (12 ms) [ RUN ] TensorBundleTest.TruncatedTensorContents [ OK ] TensorBundleTest.TruncatedTensorContents (2 ms) [ RUN ] TensorBundleTest.HeaderEntry [ OK ] TensorBundleTest.HeaderEntry (1 ms) [ RUN ] TensorBundleTest.VersionTest [ OK ] TensorBundleTest.VersionTest (0 ms) [ RUN ] TensorBundleTest.LargeVariableLoadingTest [ OK ] TensorBundleTest.LargeVariableLoadingTest (3 ms) [----------] 17 tests from TensorBundleTest (27073 ms total) [----------] 1 test from TensorBundleAlignmentTest [ RUN ] TensorBundleAlignmentTest.AlignmentTest [ OK ] TensorBundleAlignmentTest.AlignmentTest (2 ms) [----------] 1 test from TensorBundleAlignmentTest (2 ms total) [----------] Global test environment tear-down [==========] 18 tests from 2 test suites ran. (27075 ms total) [ PASSED ] 17 tests. [ FAILED ] 1 test, listed below: [ FAILED ] TensorBundleTest.StringTensors 1 FAILED TEST ================================================================================ ==================== Test output for //tensorflow/core/util/tensor_bundle:tensor_bundle_test: [==========] Running 18 tests from 2 test suites. [----------] Global test environment set-up. [----------] 17 tests from TensorBundleTest [ RUN ] TensorBundleTest.SwapBytes [ OK ] TensorBundleTest.SwapBytes (0 ms) [ RUN ] TensorBundleTest.Basic [ OK ] TensorBundleTest.Basic (177 ms) [ RUN ] TensorBundleTest.Endianness [ OK ] TensorBundleTest.Endianness (68 ms) [ RUN ] TensorBundleTest.PartitionedVariables [ OK ] TensorBundleTest.PartitionedVariables (1 ms) [ RUN ] TensorBundleTest.EquivalentSliceTest [ OK ] TensorBundleTest.EquivalentSliceTest (1 ms) [ RUN ] TensorBundleTest.NonStandardShapes [ OK ] TensorBundleTest.NonStandardShapes (17 ms) [ RUN ] TensorBundleTest.StringTensorsOldFormat [ OK ] TensorBundleTest.StringTensorsOldFormat (0 ms) [ RUN ] TensorBundleTest.StringTensors tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:765: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (writer.Add("long_scalar", long_string_tensor)) Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate7347782163562122469; No space left on device tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:768: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (writer.Add("floats", Constant_2x3<float>(16.18))) Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate7347782163562122469; No space left on device tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:769: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (writer.Finish()) Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate7347782163562122469; No space left on device [ FAILED ] TensorBundleTest.StringTensors (15126 ms) [ RUN ] TensorBundleTest.VariantTensors [ OK ] TensorBundleTest.VariantTensors (15 ms) [ RUN ] TensorBundleTest.DirectoryStructure [ OK ] TensorBundleTest.DirectoryStructure (6 ms) [ RUN ] TensorBundleTest.SortForSequentialAccess [ OK ] TensorBundleTest.SortForSequentialAccess (5 ms) [ RUN ] TensorBundleTest.Error [ OK ] TensorBundleTest.Error (4 ms) [ RUN ] TensorBundleTest.Checksum [ OK ] TensorBundleTest.Checksum (21 ms) [ RUN ] TensorBundleTest.TruncatedTensorContents [ OK ] TensorBundleTest.TruncatedTensorContents (3 ms) [ RUN ] TensorBundleTest.HeaderEntry [ OK ] TensorBundleTest.HeaderEntry (2 ms) [ RUN ] TensorBundleTest.VersionTest [ OK ] TensorBundleTest.VersionTest (1 ms) [ RUN ] TensorBundleTest.LargeVariableLoadingTest [ OK ] TensorBundleTest.LargeVariableLoadingTest (4 ms) [----------] 17 tests from TensorBundleTest (15458 ms total) [----------] 1 test from TensorBundleAlignmentTest [ RUN ] TensorBundleAlignmentTest.AlignmentTest [ OK ] TensorBundleAlignmentTest.AlignmentTest (2 ms) [----------] 1 test from TensorBundleAlignmentTest (2 ms total) [----------] Global test environment tear-down [==========] 18 tests from 2 test suites ran. (15460 ms total) [ PASSED ] 17 tests. [ FAILED ] 1 test, listed below: [ FAILED ] TensorBundleTest.StringTensors 1 FAILED TEST ================================================================================ stdout_lines: <omitted> ...ignoring TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages] *** Sunday 26 March 2023 02:56:59 +0100 (6:52:34.724) 7:46:54.782 ********** fatal: [localhost]: FAILED! => changed=false msg: 'The container "tf-py3.8" has been paused (409 Client Error for http+docker://localhost/v1.41/containers/tf-py3.8/exec: Conflict ("Container b9fa8cc82fcbcbbe82ab960070266bcec4b648873c9bd44ec11f06e2f5606dc0 is not running"))' PLAY RECAP ********************************************************************* localhost : ok=34 changed=25 unreachable=0 failed=1 skipped=8 rescued=0 ignored=1 Sunday 26 March 2023 02:57:09 +0100 (0:00:10.371) 7:47:05.153 ********** =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow git tests ------ 24754.72s tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 2889.81s tensorflow_in_container : (Python 3.8) start build container ---------- 224.97s tensorflow_in_container : (Python 3.8) build Python package ------------ 97.35s tensorflow : Fetch TensorFlow from git --------------------------------- 22.72s tensorflow_in_container : (Python 3.8) collect list of installed Python packages -- 10.37s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.63s tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build --- 2.10s Gathering Facts --------------------------------------------------------- 1.65s tensorflow_in_container : (Python 3.8) build Python versioned container --- 1.46s Create cache dirs ------------------------------------------------------- 1.38s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.24s tensorflow : Save git commit hash to file ------------------------------- 1.15s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.87s tensorflow_in_container : (Python 3.8) cleanup Bazel install directory --- 0.85s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.83s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.82s tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.72s tensorflow_in_container : (Python 3.8) create script to run tests ------- 0.72s Build step 'Execute shell' marked build as failure

1 year, 1 month

1
2
0 0

Build failed in Jenkins: Tensorflow oneDNN Python package (manylinux2014 nightly) #370

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/3…> Changes: ------------------------------------------ [...truncated 67.23 MB...] //tensorflow/compiler/tests:einsum_op_test_cpu_mlir_bridge_test PASSED in 6.9s //tensorflow/compiler/tests:extract_image_patches_op_test_cpu PASSED in 6.3s //tensorflow/compiler/tests:extract_image_patches_op_test_cpu_mlir_bridge_test PASSED in 7.9s //tensorflow/compiler/tests:fake_quant_ops_test_cpu PASSED in 14.5s //tensorflow/compiler/tests:gather_nd_op_test_cpu_mlir_bridge_test PASSED in 8.4s //tensorflow/compiler/tests:gather_test_cpu PASSED in 31.7s //tensorflow/compiler/tests:listdiff_op_test_cpu_mlir_bridge_test PASSED in 15.1s //tensorflow/compiler/tests:manip_ops_test_cpu PASSED in 9.6s //tensorflow/compiler/tests:matrix_inverse_op_test_cpu_mlir_bridge_test PASSED in 23.7s //tensorflow/compiler/tests:nary_ops_test_cpu PASSED in 13.7s //tensorflow/compiler/tests:nullary_ops_test_cpu PASSED in 9.1s //tensorflow/compiler/tests:reduce_window_test_cpu PASSED in 8.1s //tensorflow/compiler/tests:reverse_sequence_op_test_cpu PASSED in 8.2s //tensorflow/compiler/tests:searchsorted_op_test_cpu PASSED in 7.7s //tensorflow/compiler/tests:segment_reduction_ops_test_cpu_mlir_bridge_test PASSED in 32.1s //tensorflow/compiler/tests:self_adjoint_eig_op_test_cpu PASSED in 17.0s //tensorflow/compiler/tests:sparse_to_dense_op_test_cpu PASSED in 8.4s //tensorflow/compiler/tests:tridiagonal_solve_ops_test_cpu PASSED in 17.4s //tensorflow/compiler/tests:where_op_test_cpu PASSED in 12.0s //tensorflow/compiler/xla:array4d_test PASSED in 0.2s //tensorflow/compiler/xla:debug_options_parsers_test PASSED in 0.3s //tensorflow/compiler/xla:layout_test PASSED in 0.2s //tensorflow/compiler/xla:text_literal_reader_test PASSED in 0.2s //tensorflow/compiler/xla/client:xla_builder_test PASSED in 0.3s //tensorflow/compiler/xla/client/lib:arithmetic_test_cpu PASSED in 6.2s //tensorflow/compiler/xla/client/lib:pooling_test_cpu PASSED in 6.9s //tensorflow/compiler/xla/client/lib:qr_test_cpu PASSED in 10.9s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:add_hlo_trace.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/deallocation/split_alloc_tensors.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/inline_fusion_clusters.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/reverse.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/constraint_fusion.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/convert_to_signless.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/expand_hlo_tuples.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-collapse-elementwise-map.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-arithmetic.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-stablehlo-experimental.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/lower-general-dot.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_bytecode_customizations.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/thlo/canonicalize.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/thlo/legalize_sort.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/pjrt:pjrt_api_test PASSED in 0.2s //tensorflow/compiler/xla/pjrt:tracked_device_buffer_test PASSED in 9.6s //tensorflow/compiler/xla/pjrt/distributed:client_server_test PASSED in 44.0s //tensorflow/compiler/xla/python/ifrt:array_test PASSED in 0.2s //tensorflow/compiler/xla/python/pjrt_ifrt:pjrt_client_impl_test_tfrt_cpu PASSED in 5.6s //tensorflow/compiler/xla/python/pjrt_ifrt:pjrt_tuple_impl_test_tfrt_cpu PASSED in 5.9s //tensorflow/compiler/xla/python_api:xla_shape_test PASSED in 0.9s //tensorflow/compiler/xla/runtime:map_by_type_test PASSED in 0.2s //tensorflow/compiler/xla/service:hlo_dataflow_analysis_test PASSED in 2.7s //tensorflow/compiler/xla/service:hlo_element_type_converter_test PASSED in 0.8s //tensorflow/compiler/xla/service:hlo_ordering_test PASSED in 0.8s //tensorflow/compiler/xla/service:hlo_pass_pipeline_test PASSED in 0.8s //tensorflow/compiler/xla/service:sharding_remover_test PASSED in 1.1s //tensorflow/compiler/xla/service:while_loop_simplifier_test PASSED in 0.8s //tensorflow/compiler/xla/service/gpu:hlo_fusion_stats_test PASSED in 0.9s //tensorflow/compiler/xla/service/gpu:instruction_fusion_test PASSED in 1.3s //tensorflow/compiler/xla/tests:all_reduce_test_cpu PASSED in 6.6s //tensorflow/compiler/xla/tests:axpy_simple_test_cpu PASSED in 5.9s //tensorflow/compiler/xla/tests:binop_scaling_test_cpu PASSED in 6.9s //tensorflow/compiler/xla/tests:floor_ceil_test_cpu PASSED in 6.3s //tensorflow/compiler/xla/tests:matrix_ops_simple_test_cpu PASSED in 12.2s //tensorflow/compiler/xla/tests:multithreaded_compilation_test_cpu PASSED in 7.4s //tensorflow/compiler/xla/tests:token_hlo_test_cpu PASSED in 6.7s //tensorflow/compiler/xla/tests:tuple_test_cpu PASSED in 6.7s //tensorflow/compiler/xla/tests:vector_ops_simple_test_cpu PASSED in 7.7s //tensorflow/compiler/xla/tools:hlo_module_loader_test PASSED in 1.3s //tensorflow/compiler/xla/tools/hlo_bisect:hlo_bisect_state_test PASSED in 1.4s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:case_conditional.hlotxt.test PASSED in 0.6s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:dynamic_param.hlo.test PASSED in 0.5s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:entry_computation_layout.hlotxt.test PASSED in 0.7s //tensorflow/core:__tensorflow_core_lib_strings_legacy_low_level_library_tests PASSED in 0.1s //tensorflow/core:lib_strings_ordered_code_test PASSED in 1.2s //tensorflow/core/common_runtime:cost_measurement_registry_test PASSED in 2.4s //tensorflow/core/common_runtime:mkl_threadpool_device_test PASSED in 0.1s //tensorflow/core/common_runtime:quantize_training_test PASSED in 1.8s //tensorflow/core/data/service/snapshot:distributed_snapshot_test PASSED in 57.9s //tensorflow/core/distributed_runtime/integration_test:c_api_multi_client_test_cpu PASSED in 25.5s //tensorflow/core/distributed_runtime/integration_test:c_api_recoverable_jobs_test_cpu PASSED in 36.1s //tensorflow/core/framework:kernel_def_builder_test PASSED in 0.9s //tensorflow/core/framework:types_test PASSED in 0.7s //tensorflow/core/function/capture:by_ref_capture_test PASSED in 46.3s //tensorflow/core/function/polymorphism:function_type_test PASSED in 44.6s //tensorflow/core/function/polymorphism:type_dispatch_test PASSED in 41.1s //tensorflow/core/function/trace_type:default_types_test PASSED in 6.6s //tensorflow/core/function/trace_type:serialization_test PASSED in 6.4s //tensorflow/core/graph:collective_order_test PASSED in 0.5s //tensorflow/core/graph:graph_def_builder_test PASSED in 1.0s //tensorflow/core/grappler:graph_view_test PASSED in 2.2s //tensorflow/core/grappler:mutable_graph_view_test PASSED in 1.7s //tensorflow/core/grappler:utils_test PASSED in 2.5s //tensorflow/core/grappler/costs:cost_estimator_test PASSED in 0.2s //tensorflow/core/grappler/inputs:utils_test PASSED in 0.1s //tensorflow/core/grappler/optimizers:function_api_info_test PASSED in 0.1s //tensorflow/core/grappler/optimizers:generic_layout_optimizer_transposer_factory_test PASSED in 0.2s //tensorflow/core/grappler/optimizers:graph_optimizer_stage_test_cpu PASSED in 2.5s //tensorflow/core/grappler/optimizers:loop_optimizer_test_cpu PASSED in 1.9s //tensorflow/core/grappler/optimizers:static_schedule_test_cpu PASSED in 1.5s //tensorflow/core/grappler/optimizers:tfg_optimizer_hook_test PASSED in 0.5s //tensorflow/core/grappler/optimizers/data:map_parallelization_test PASSED in 0.6s //tensorflow/core/grappler/optimizers/data:replicate_on_split_test PASSED in 0.6s //tensorflow/core/grappler/utils:canonicalizer_test PASSED in 1.3s //tensorflow/core/grappler/utils:colocation_test PASSED in 0.5s //tensorflow/core/grappler/utils:topological_sort_test PASSED in 0.5s //tensorflow/core/grappler/utils:tpu_test PASSED in 0.2s //tensorflow/core/ir:ops_test PASSED in 0.1s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:empty.pbtxt.test PASSED in 1.6s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_duplicated_node_name.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_generic_function_attr_name.pbtxt.test PASSED in 0.6s //tensorflow/core/ir/importexport/tests/mlir_to_graphdef:three_nodes_with_attrs.mlir.test PASSED in 0.6s //tensorflow/core/kernels:matmul_op_test_cpu PASSED in 2.9s //tensorflow/core/kernels:mfcc_dct_test PASSED in 0.1s //tensorflow/core/kernels:ops_util_test PASSED in 0.2s //tensorflow/core/kernels:reduction_ops_test_cpu PASSED in 0.4s //tensorflow/core/kernels:scatter_nd_op_test_cpu PASSED in 1.2s //tensorflow/core/transforms:eval_utils_test PASSED in 1.4s //tensorflow/dtensor/mlir/tests:function_renaming.mlir.test PASSED in 0.6s //tensorflow/python/autograph/tests:type_annotations_test PASSED in 17.6s //tensorflow/python/checkpoint:checkpoint_with_v1_optimizers_test PASSED in 20.1s //tensorflow/python/checkpoint:restore_test PASSED in 12.3s //tensorflow/python/checkpoint:save_util_v1_test PASSED in 10.5s //tensorflow/python/client:device_lib_test_cpu PASSED in 16.1s //tensorflow/python/grappler:arithmetic_optimizer_test_cpu PASSED in 13.4s //tensorflow/python/kernel_tests/array_ops:constant_op_test_cpu PASSED in 8.7s //tensorflow/python/kernel_tests/data_structures:stage_op_test_cpu PASSED in 12.1s //tensorflow/python/kernel_tests/io_ops:record_input_test PASSED in 31.1s //tensorflow/python/kernel_tests/linalg:determinant_op_test_cpu PASSED in 9.8s //tensorflow/python/kernel_tests/linalg:matrix_solve_ls_op_test_cpu PASSED in 23.3s //tensorflow/python/kernel_tests/random:random_grad_test_cpu PASSED in 7.3s //tensorflow/python/kernel_tests/random:stateful_random_ops_test_cpu PASSED in 16.2s //tensorflow/python/kernel_tests/signal:shape_ops_test_cpu PASSED in 22.0s //tensorflow/python/kernel_tests/sparse_ops:sparse_tensors_map_ops_test PASSED in 7.3s //tensorflow/python/kernel_tests/strings_ops:unicode_transcode_op_test PASSED in 6.8s //tensorflow/python/ops/losses:util_test PASSED in 5.3s //tensorflow/python/ops/numpy_ops/integration_test:np_config_test_cpu PASSED in 17.8s //tensorflow/python/ops/ragged:ragged_bitcast_op_test PASSED in 8.1s //tensorflow/python/ops/ragged:ragged_math_ops_test PASSED in 11.2s //tensorflow/python/ops/ragged:ragged_print_op_test PASSED in 57.9s //tensorflow/python/ops/ragged:ragged_reduce_op_test PASSED in 26.7s //tensorflow/python/ops/ragged:ragged_row_lengths_op_test PASSED in 7.6s //tensorflow/python/ops/ragged:ragged_util_test PASSED in 18.4s //tensorflow/python/ops/structured:structured_tensor_test PASSED in 35.1s //tensorflow/python/saved_model/model_utils:export_output_test PASSED in 9.4s //tensorflow/python/summary/writer:writer_test PASSED in 30.6s //tensorflow/python/tools:optimize_for_inference_test PASSED in 45.5s //tensorflow/tsl/distributed_runtime/coordination:coordination_service_error_util_test PASSED in 0.8s //tensorflow/tsl/framework:cancellation_test PASSED in 1.5s //tensorflow/tsl/lib/gtl:tsl_lib_gtl_tests PASSED in 0.2s //tensorflow/tsl/lib/random:distribution_sampler_test PASSED in 0.4s //tensorflow/tsl/platform:float8_test PASSED in 0.7s //tensorflow/tsl/platform:mutex_test PASSED in 0.4s //tensorflow/tsl/platform:random_test PASSED in 1.9s //tensorflow/tsl/platform:retrying_utils_test PASSED in 0.4s //tensorflow/tsl/profiler/utils:parse_annotation_test PASSED in 0.4s //tensorflow/compiler/tests:spacetobatch_op_test_cpu_mlir_bridge_test PASSED in 10.9s Stats over 3 runs: max = 10.9s, min = 10.1s, avg = 10.4s, dev = 0.3s //tensorflow/compiler/xla/tests:triangular_solve_test_cpu PASSED in 51.6s Stats over 3 runs: max = 51.6s, min = 49.2s, avg = 50.4s, dev = 1.0s //tensorflow/compiler/tests:unary_ops_test_cpu PASSED in 30.0s Stats over 4 runs: max = 30.0s, min = 12.4s, avg = 21.9s, dev = 7.3s //tensorflow/python/ops/ragged:ragged_getitem_test PASSED in 44.9s Stats over 4 runs: max = 44.9s, min = 39.6s, avg = 42.3s, dev = 2.0s //tensorflow/compiler/tests:depthwise_conv_op_test_cpu_mlir_bridge_test PASSED in 13.5s Stats over 5 runs: max = 13.5s, min = 7.7s, avg = 10.4s, dev = 2.2s //tensorflow/compiler/tests:repeat_op_test_cpu PASSED in 7.2s Stats over 5 runs: max = 7.2s, min = 6.0s, avg = 6.3s, dev = 0.4s //tensorflow/python/kernel_tests/linalg:cholesky_op_test_cpu PASSED in 74.9s Stats over 5 runs: max = 74.9s, min = 32.9s, avg = 46.9s, dev = 14.9s //tensorflow/compiler/tests:matrix_diag_ops_test_cpu PASSED in 51.4s Stats over 8 runs: max = 51.4s, min = 3.0s, avg = 19.8s, dev = 16.0s //tensorflow/compiler/tests:conv2d_test_cpu_mlir_bridge_test PASSED in 18.5s Stats over 10 runs: max = 18.5s, min = 16.0s, avg = 17.3s, dev = 0.7s //tensorflow/compiler/tests:stateless_random_ops_test_cpu_mlir_bridge_test PASSED in 65.3s Stats over 10 runs: max = 65.3s, min = 31.0s, avg = 48.4s, dev = 11.7s //tensorflow/python/kernel_tests/random:stateless_random_ops_test_cpu PASSED in 95.4s Stats over 10 runs: max = 95.4s, min = 17.8s, avg = 53.5s, dev = 34.4s //tensorflow/compiler/xla/service:triangular_solve_expander_test PASSED in 5.9s Stats over 12 runs: max = 5.9s, min = 2.6s, avg = 3.7s, dev = 0.8s //tensorflow/python/kernel_tests/signal:dct_ops_test_cpu PASSED in 10.3s Stats over 16 runs: max = 10.3s, min = 5.7s, avg = 8.0s, dev = 1.7s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 13.1s Stats over 20 runs: max = 13.1s, min = 4.2s, avg = 7.4s, dev = 2.4s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 10.3s Stats over 20 runs: max = 10.3s, min = 2.5s, avg = 4.5s, dev = 2.0s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 22.4s Stats over 20 runs: max = 22.4s, min = 13.8s, avg = 18.2s, dev = 2.6s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 97.0s Stats over 20 runs: max = 97.0s, min = 25.1s, avg = 51.8s, dev = 19.8s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 22.1s Stats over 20 runs: max = 22.1s, min = 5.9s, avg = 14.0s, dev = 6.4s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 27.7s Stats over 30 runs: max = 27.7s, min = 2.8s, avg = 9.1s, dev = 6.2s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 9.3s Stats over 40 runs: max = 9.3s, min = 6.2s, avg = 7.2s, dev = 0.7s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 93.0s Stats over 50 runs: max = 93.0s, min = 18.7s, avg = 41.1s, dev = 25.1s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 34.4s Stats over 50 runs: max = 34.4s, min = 2.4s, avg = 9.1s, dev = 6.9s Executed 348 out of 3632 tests: 348 tests pass, 2785 fail to build and 499 were skipped. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages] *** Friday 17 March 2023 03:32:12 +0000 (0:43:02.932) 1:36:08.230 ********** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) save list of installed Python packages] *** Friday 17 March 2023 03:32:14 +0000 (0:00:01.882) 1:36:10.112 ********** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) save tests output to file] ******** Friday 17 March 2023 03:32:15 +0000 (0:00:00.705) 1:36:10.818 ********** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) save tests stderr output to file] *** Friday 17 March 2023 03:32:15 +0000 (0:00:00.846) 1:36:11.664 ********** An exception occurred during task execution. To see the full traceback, use -vvv. The error was: OSError: [Errno 28] No space left on device fatal: [localhost]: FAILED! => msg: Unexpected failure during module execution. stdout: '' PLAY RECAP ********************************************************************* localhost : ok=37 changed=28 unreachable=0 failed=1 skipped=8 rescued=0 ignored=1 Friday 17 March 2023 03:32:16 +0000 (0:00:00.351) 1:36:12.016 ********** =============================================================================== tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git 2905.00s tensorflow_in_container : (Python 3.8) run TensorFlow-oneDNN-ACL git tests 2582.93s tensorflow_in_container : (Python 3.8) build Python package ----------- 116.95s tensorflow_in_container : (Python 3.8) start build container ---------- 116.61s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 21.43s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.68s tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build --- 2.05s tensorflow_in_container : (Python 3.8) collect list of installed Python packages --- 1.88s Gathering Facts --------------------------------------------------------- 1.64s tensorflow_in_container : (Python 3.8) build Python versioned container --- 1.59s Create cache dirs ------------------------------------------------------- 1.38s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.25s tensorflow : Save git commit hash to file ------------------------------- 1.11s tensorflow_in_container : (Python 3.8) cleanup Bazel install directory --- 0.91s tensorflow_in_container : (Python 3.8) save tests output to file -------- 0.85s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.84s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.81s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.79s tensorflow : Create readme file about unit tests ------------------------ 0.74s Build step 'Execute shell' marked build as failure

1 year, 2 months

1
1
0 0

Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #727

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/727/disp…> Changes: ------------------------------------------ [...truncated 68.94 KB...] /dt10/usr/bin/gcc @bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/service/cpu/ir_emission_utils_test-2.params) # Configuration: b52fe58f1775b8e936e1eeafc4af662c6a41494ccccc6a033d1493e478ebef09 # Execution platform: @ml2014_aarch64_config_aarch64_platform//:platform /usr/bin/ld: final link failed: No space left on device collect2: error: ld returned 1 exit status ERROR: /tf/tensorflow/tensorflow/compiler/xla/tests/BUILD:692:9: Linking tensorflow/compiler/xla/tests/unary_op_test_cpu failed: (Exit 1): gcc failed: error executing command (cd /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow && \ exec env - \ CACHEBUSTER=20220325 \ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin \ PWD=/proc/self/cwd \ PYTHON_BIN_PATH=/usr/local/bin/python3 \ TF2_BEHAVIOR=1 \ /dt10/usr/bin/gcc @bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/tests/unary_op_test_cpu-2.params) # Configuration: b52fe58f1775b8e936e1eeafc4af662c6a41494ccccc6a033d1493e478ebef09 # Execution platform: @ml2014_aarch64_config_aarch64_platform//:platform /usr/bin/ld: final link failed: No space left on device collect2: error: ld returned 1 exit status ERROR: /tf/tensorflow/tensorflow/compiler/xla/tests/BUILD:2785:12: Compiling tensorflow/compiler/xla/tests/multiple_devices_on_host_test.cc failed: (Exit 1): gcc failed: error executing command (cd /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow && \ exec env - \ CACHEBUSTER=20220325 \ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin \ PWD=/proc/self/cwd \ PYTHON_BIN_PATH=/usr/local/bin/python3 \ TF2_BEHAVIOR=1 \ /dt10/usr/bin/gcc -MD -MF bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/tests/_objs/multiple_devices_on_host_test/multiple_devices_on_host_test.d '-frandom-seed=bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/tests/_objs/multiple_devices_on_host_test/multiple_devices_on_host_test.o' -DEIGEN_MPL2_ONLY '-DEIGEN_MAX_ALIGN_BYTES=64' -DBENCHMARK_STATIC_DEFINE -DHAVE_SYS_UIO_H -DTF_USE_SNAPPY '-DGRPC_ARES=0' '-DLLVM_ON_UNIX=1' '-DHAVE_BACKTRACE=1' '-DBACKTRACE_HEADER=<execinfo.h>' '-DLTDL_SHLIB_EXT=".so"' '-DLLVM_PLUGIN_EXT=".so"' '-DLLVM_ENABLE_THREADS=1' '-DHAVE_DEREGISTER_FRAME=1' '-DHAVE_LIBPTHREAD=1' '-DHAVE_PTHREAD_GETNAME_NP=1' '-DHAVE_PTHREAD_H=1' '-DHAVE_PTHREAD_SETNAME_NP=1' '-DHAVE_REGISTER_FRAME=1' '-DHAVE_SETENV_R=1' '-DHAVE_STRERROR_R=1' '-DHAVE_SYSEXITS_H=1' '-DHAVE_UNISTD_H=1' -D_GNU_SOURCE '-DHAVE_LINK_H=1' '-DHAVE_LSEEK64=1' '-DHAVE_MALLINFO=1' '-DHAVE_SBRK=1' '-DHAVE_STRUCT_STAT_ST_MTIM_TV_NSEC=1' '-DLLVM_NATIVE_ARCH="AArch64"' '-DLLVM_NATIVE_ASMPARSER=LLVMInitializeAArch64AsmParser' '-DLLVM_NATIVE_ASMPRINTER=LLVMInitializeAArch64AsmPrinter' '-DLLVM_NATIVE_DISASSEMBLER=LLVMInitializeAArch64Disassembler' '-DLLVM_NATIVE_TARGET=LLVMInitializeAArch64Target' '-DLLVM_NATIVE_TARGETINFO=LLVMInitializeAArch64TargetInfo' '-DLLVM_NATIVE_TARGETMC=LLVMInitializeAArch64TargetMC' '-DLLVM_NATIVE_TARGETMCA=LLVMInitializeAArch64TargetMCA' '-DLLVM_HOST_TRIPLE="aarch64-unknown-linux-gnu"' '-DLLVM_DEFAULT_TARGET_TRIPLE="aarch64-unknown-linux-gnu"' '-DLLVM_VERSION_MAJOR=17' '-DLLVM_VERSION_MINOR=0' '-DLLVM_VERSION_PATCH=0' '-DLLVM_VERSION_STRING="17.0.0git"' -D__STDC_LIMIT_MACROS -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS '-DBLAKE3_USE_NEON=0' -DBLAKE3_NO_AVX2 -DBLAKE3_NO_AVX512 -DBLAKE3_NO_SSE2 -DBLAKE3_NO_SSE41 -DTENSORFLOW_USE_CUSTOM_CONTRACTION_KERNEL -DGEMM_KERNEL_H '-DEIGEN_ALTIVEC_USE_CUSTOM_PACK=0' '-DEIGEN_NEON_GEBP_NR=4' -iquote . -iquote bazel-out/aarch64-opt/bin -iquote external/eigen_archive -iquote bazel-out/aarch64-opt/bin/external/eigen_archive -iquote external/com_google_absl -iquote bazel-out/aarch64-opt/bin/external/com_google_absl -iquote external/nsync -iquote bazel-out/aarch64-opt/bin/external/nsync -iquote external/com_google_protobuf -iquote bazel-out/aarch64-opt/bin/external/com_google_protobuf -iquote external/double_conversion -iquote bazel-out/aarch64-opt/bin/external/double_conversion -iquote external/com_google_googletest -iquote bazel-out/aarch64-opt/bin/external/com_google_googletest -iquote external/com_google_benchmark -iquote bazel-out/aarch64-opt/bin/external/com_google_benchmark -iquote external/snappy -iquote bazel-out/aarch64-opt/bin/external/snappy -iquote external/com_googlesource_code_re2 -iquote bazel-out/aarch64-opt/bin/external/com_googlesource_code_re2 -iquote external/com_github_grpc_grpc -iquote bazel-out/aarch64-opt/bin/external/com_github_grpc_grpc -iquote external/zlib -iquote bazel-out/aarch64-opt/bin/external/zlib -iquote external/upb -iquote bazel-out/aarch64-opt/bin/external/upb -iquote external/boringssl -iquote bazel-out/aarch64-opt/bin/external/boringssl -iquote external/farmhash_archive -iquote bazel-out/aarch64-opt/bin/external/farmhash_archive -iquote external/llvm-project -iquote bazel-out/aarch64-opt/bin/external/llvm-project -iquote external/llvm_terminfo -iquote bazel-out/aarch64-opt/bin/external/llvm_terminfo -iquote external/llvm_zlib -iquote bazel-out/aarch64-opt/bin/external/llvm_zlib -iquote external/tf_runtime -iquote bazel-out/aarch64-opt/bin/external/tf_runtime -iquote external/stablehlo -iquote bazel-out/aarch64-opt/bin/external/stablehlo -iquote external/bazel_tools -iquote bazel-out/aarch64-opt/bin/external/bazel_tools -Ibazel-out/aarch64-opt/bin/external/com_google_benchmark/_virtual_includes/benchmark -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BuiltinAttributeInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BuiltinAttributesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BuiltinDialectIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BuiltinLocationAttributesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BuiltinOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BuiltinTypeInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BuiltinTypesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/CallOpInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/CastOpInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/FunctionInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/InferTypeOpInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/OpAsmInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/RegionKindInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/SideEffectInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/SymbolInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TensorEncodingIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ArithBaseIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ArithCanonicalizationIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ArithOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ArithOpsInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/InferIntRangeInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/VectorInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ControlFlowInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LoopLikeInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/AsmParserTokenKinds -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/DialectUtilsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ViewLikeInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/PDLOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/PDLTypesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/PDLInterpOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ConversionPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/RuntimeVerifiableOpInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TransformsPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/InstCombineTableGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/JITLinkTableGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ControlFlowOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/FuncIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/AsyncOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/X86CodeGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/X86CommonTableGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/X86Info -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/X86UtilsAndDesc -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/AArch64CodeGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/AArch64CommonTableGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/AArch64Info -Ibazel-out/aarch64-opt/bin/external/llvm-project/llvm/_virtual_includes/AArch64UtilsAndDesc -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LLVMDialectInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LLVMIntrinsicOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LLVMOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LLVMTypesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/MathBaseIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/MathOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/CopyOpInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/MemRefBaseIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/MemRefOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ShapedOpInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/AffineMemoryOpInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/AffineOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/AllocationOpInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BufferizableOpInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BufferizationBaseIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BufferizationEnumsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BufferizationOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/DestinationStyleOpInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/SparseTensorAttrDefsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/SparseTensorOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/SparseTensorTypesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ComplexAttributesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ComplexBaseIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ComplexOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ParallelCombiningOpInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TensorOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TilingInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/BufferizationPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/FuncTransformsPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/SCFDeviceMappingInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/SCFIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/SCFPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/DLTIBaseIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LLVMConversionIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LLVMPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/NVVMOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LLVMIntrinsicConversionIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/OpenMPInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/OpenMPOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/OpenMPTypeInterfacesIncGen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/mlir_hlo -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/canonicalize_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/convert_op_folder -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/hlo_ops_attrs_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/hlo_ops_common -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/hlo_ops_enums_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/hlo_ops_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/hlo_ops_pattern_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/hlo_ops_typedefs_inc_gen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/QuantOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/MLIRShapeCanonicalizationIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ShapeOpsIncGen -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/base -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/base_attr_interfaces_inc_gen -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/broadcast_utils -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/chlo_ops -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/chlo_attrs_inc_gen -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/chlo_enums_inc_gen -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/chlo_ops_inc_gen -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/stablehlo_assembly_format -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/stablehlo_type_inference -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/lhlo -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/lhlo_ops_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/lhlo_ops_structs_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/lhlo_structured_interface -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/lhlo_structured_interface_inc_gen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/MaskableOpInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/MaskingOpInterfaceIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/VectorOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ArithPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/GPUBaseIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/GPUOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LinalgEnumsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LinalgInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LinalgOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LinalgStructuredOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/LinalgPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/MemRefPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TensorPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/VectorEnumsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/VectorPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/X86VectorIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/AMXIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ArmNeonIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ArmSVEIncGen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/all_passes -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/chlo_legalize_to_hlo -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/chlo_legalize_to_hlo_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/map_chlo_to_hlo_op -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/deallocation_passes -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/deallocation -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/deallocation_ops_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/deallocation_utils -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/deallocation_passes_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/gml_st_passes -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/gml_st -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/gml_st_ops_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/gml_st_passes_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/gml_st_transforms -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/thlo -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/thlo_ops_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/type_conversion -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/stablehlo_ops -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/stablehlo_attrs_inc_gen -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/stablehlo_enums_inc_gen -Ibazel-out/aarch64-opt/bin/external/stablehlo/_virtual_includes/stablehlo_ops_inc_gen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ShapeTransformsPassIncGen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/lmhlo_pass_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/lmhlo_passes -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/map_lmhlo_to_scalar_op -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/map_lhlo_to_hlo_op -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/map_mhlo_to_scalar_op -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/mhlo_pass_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/mhlo_passes -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/hlo_legalize_to_stablehlo -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/map_stablehlo_to_hlo_op -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/legalize_to_linalg_utils -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/legalize_to_standard_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/lower_complex_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/map_hlo_to_lhlo_op -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/mhlo_rng_utils -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/mhlo_scatter_gather_utils -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/shape_component_analysis -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/stablehlo_legalize_to_hlo -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/thlo_bufferizable_op_interface -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/unfuse_batch_norm -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/thlo_passes -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/thlo_passes_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/transforms_passes -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/transforms_passes_inc_gen -Ibazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/_virtual_includes/userange_analysis -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TransformDialectEnumsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TransformDialectIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TransformDialectInterfacesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TransformOpsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TransformTypesIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/TransformDialectTransformsIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ShapeToStandardGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/SparseTensorPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/AMXConversionIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ArmNeonConversionIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/ArmSVEConversionIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/AsyncPassIncGen -Ibazel-out/aarch64-opt/bin/external/llvm-project/mlir/_virtual_includes/X86VectorConversionIncGen -isystem external/eigen_archive -isystem bazel-out/aarch64-opt/bin/external/eigen_archive -isystem external/nsync/public -isystem bazel-out/aarch64-opt/bin/external/nsync/public -isystem external/com_google_protobuf/src -isystem bazel-out/aarch64-opt/bin/external/com_google_protobuf/src -isystem external/com_google_googletest/googlemock -isystem bazel-out/aarch64-opt/bin/external/com_google_googletest/googlemock -isystem external/com_google_googletest/googlemock/include -isystem bazel-out/aarch64-opt/bin/external/com_google_googletest/googlemock/include -isystem external/com_google_googletest/googletest -isystem bazel-out/aarch64-opt/bin/external/com_google_googletest/googletest -isystem external/com_google_googletest/googletest/include -isystem bazel-out/aarch64-opt/bin/external/com_google_googletest/googletest/include -isystem external/com_github_grpc_grpc/include -isystem bazel-out/aarch64-opt/bin/external/com_github_grpc_grpc/include -isystem external/com_github_grpc_grpc/src/core/ext/upb-generated -isystem bazel-out/aarch64-opt/bin/external/com_github_grpc_grpc/src/core/ext/upb-generated -isystem external/zlib -isystem bazel-out/aarch64-opt/bin/external/zlib -isystem external/com_github_grpc_grpc/third_party/address_sorting/include -isystem bazel-out/aarch64-opt/bin/external/com_github_grpc_grpc/third_party/address_sorting/include -isystem external/boringssl/src/include -isystem bazel-out/aarch64-opt/bin/external/boringssl/src/include -isystem external/farmhash_archive/src -isystem bazel-out/aarch64-opt/bin/external/farmhash_archive/src -isystem external/llvm-project/llvm/include -isystem bazel-out/aarch64-opt/bin/external/llvm-project/llvm/include -isystem external/llvm-project/mlir/include -isystem bazel-out/aarch64-opt/bin/external/llvm-project/mlir/include -isystem external/tf_runtime/include -isystem bazel-out/aarch64-opt/bin/external/tf_runtime/include -isystem external/tf_runtime/third_party/llvm_derived/include -isystem bazel-out/aarch64-opt/bin/external/tf_runtime/third_party/llvm_derived/include -isystem external/llvm-project/llvm/lib/Target/X86 -isystem bazel-out/aarch64-opt/bin/external/llvm-project/llvm/lib/Target/X86 -isystem external/llvm-project/llvm/lib/Target/AArch64 -isystem bazel-out/aarch64-opt/bin/external/llvm-project/llvm/lib/Target/AArch64 -isystem tensorflow/compiler/xla/translate/hlo_to_mhlo/include -isystem bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/translate/hlo_to_mhlo/include -isystem external/llvm-project/mlir/lib/Conversion/TensorToLinalg -isystem bazel-out/aarch64-opt/bin/external/llvm-project/mlir/lib/Conversion/TensorToLinalg -Wno-builtin-macro-redefined '-D__DATE__="redacted"' '-D__TIMESTAMP__="redacted"' '-D__TIME__="redacted"' -fPIE -U_FORTIFY_SOURCE '-D_FORTIFY_SOURCE=1' -fstack-protector -Wall -fno-omit-frame-pointer -no-canonical-prefixes -fno-canonical-system-headers -DNDEBUG -g0 -O2 -ffunction-sections -fdata-sections -Wno-all -Wno-extra -Wno-deprecated -Wno-deprecated-declarations -Wno-ignored-attributes -Wno-array-bounds -Wunused-result '-Werror=unused-result' -Wswitch '-Werror=switch' '-Wno-error=unused-but-set-variable' -DAUTOLOAD_DYNAMIC_KERNELS '-mtune=generic' '-march=armv8-a' -O3 '-std=c++17' '--sysroot=/dt10' -c tensorflow/compiler/xla/tests/multiple_devices_on_host_test.cc -o bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/tests/_objs/multiple_devices_on_host_test/multiple_devices_on_host_test.o) # Configuration: b52fe58f1775b8e936e1eeafc4af662c6a41494ccccc6a033d1493e478ebef09 # Execution platform: @ml2014_aarch64_config_aarch64_platform//:platform ERROR: /tf/tensorflow/tensorflow/core/distributed_runtime/rpc/BUILD:398:13: Linking tensorflow/core/distributed_runtime/rpc/grpc_testlib_server failed: (Exit 1): gcc failed: error executing command (cd /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow && \ exec env - \ CACHEBUSTER=20220325 \ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin \ PWD=/proc/self/cwd \ PYTHON_BIN_PATH=/usr/local/bin/python3 \ TF2_BEHAVIOR=1 \ /dt10/usr/bin/gcc @bazel-out/aarch64-opt/bin/tensorflow/core/distributed_runtime/rpc/grpc_testlib_server-2.params) # Configuration: b52fe58f1775b8e936e1eeafc4af662c6a41494ccccc6a033d1493e478ebef09 # Execution platform: @ml2014_aarch64_config_aarch64_platform//:platform No space left on device collect2: error: ld returned 1 exit status ERROR: /tf/tensorflow/tensorflow/compiler/xla/service/BUILD:3159:12: Linking tensorflow/compiler/xla/service/while_loop_simplifier_test failed: (Exit 1): gcc failed: error executing command (cd /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow && \ exec env - \ CACHEBUSTER=20220325 \ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin \ PWD=/proc/self/cwd \ PYTHON_BIN_PATH=/usr/local/bin/python3 \ TF2_BEHAVIOR=1 \ /dt10/usr/bin/gcc @bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/service/while_loop_simplifier_test-2.params) # Configuration: b52fe58f1775b8e936e1eeafc4af662c6a41494ccccc6a033d1493e478ebef09 # Execution platform: @ml2014_aarch64_config_aarch64_platform//:platform : final link failed: No space left on device collect2: error: ld returned 1 exit status ERROR: /tf/tensorflow/tensorflow/compiler/xla/service/BUILD:4574:12: Linking tensorflow/compiler/xla/service/memory_space_assignment_best_fit_repacker_test failed: Exec failed due to IOException: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/local-spawn-runner.3667359627142337217: No space left on device ERROR: /tf/tensorflow/tensorflow/compiler/xla/mlir_hlo/tests/BUILD:11:13: Creating source manifest for //tensorflow/compiler/xla/mlir_hlo/tests:rank-specialization.mlir.test failed: unexpected I/O exception: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/mlir_hlo/tests/rank-specialization.mlir.test.runfiles_manifest (No space left on device) ERROR: /tf/tensorflow/tensorflow/compiler/xla/service/cpu/BUILD:1451:12: Linking tensorflow/compiler/xla/service/cpu/cpu_eigen_tensor_alignment_test failed: (Exit 1): gcc failed: error executing command (cd /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow && \ exec env - \ CACHEBUSTER=20220325 \ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin \ PWD=/proc/self/cwd \ PYTHON_BIN_PATH=/usr/local/bin/python3 \ TF2_BEHAVIOR=1 \ /dt10/usr/bin/gcc @bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/service/cpu/cpu_eigen_tensor_alignment_test-2.params) # Configuration: b52fe58f1775b8e936e1eeafc4af662c6a41494ccccc6a033d1493e478ebef09 # Execution platform: @ml2014_aarch64_config_aarch64_platform//:platform /usr/bin/ld: final link failed: No space left on device collect2: error: ld returned 1 exit status ERROR: /tf/tensorflow/tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir/BUILD:8:15: Expanding template tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir/arg-data-type.pbtxt.test failed: unexpected I/O exception: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir/arg-data-type.pbtxt.test (No space left on device) ERROR: /tf/tensorflow/tensorflow/compiler/xla/service/BUILD:5631:12: Writing file tensorflow/compiler/xla/service/tuple_util_test-2.params failed: unexpected I/O exception: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/service/tuple_util_test-2.params (No space left on device) ERROR: /tf/tensorflow/tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir/BUILD:8:15: Creating source manifest for //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:arg-data-type.pbtxt.test failed: unexpected I/O exception: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir/arg-data-type.pbtxt.test.runfiles_manifest (No space left on device) ERROR: /tf/tensorflow/tensorflow/compiler/xla/service/BUILD:5631:12: Creating source manifest for //tensorflow/compiler/xla/service:tuple_util_test failed: unexpected I/O exception: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/service/tuple_util_test.runfiles_manifest (No space left on device) ERROR: /tf/tensorflow/tensorflow/compiler/xla/service/cpu/BUILD:1284:12: Linking tensorflow/compiler/xla/service/cpu/cpu_layout_assignment_test failed: (Exit 1): gcc failed: error executing command (cd /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow && \ exec env - \ CACHEBUSTER=20220325 \ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin \ PWD=/proc/self/cwd \ PYTHON_BIN_PATH=/usr/local/bin/python3 \ TF2_BEHAVIOR=1 \ /dt10/usr/bin/gcc @bazel-out/aarch64-opt/bin/tensorflow/compiler/xla/service/cpu/cpu_layout_assignment_test-2.params) # Configuration: b52fe58f1775b8e936e1eeafc4af662c6a41494ccccc6a033d1493e478ebef09 # Execution platform: @ml2014_aarch64_config_aarch64_platform//:platform /usr/bin/ld: final link failed: No space left on device collect2: error: ld returned 1 exit status WARNING: Remote Cache: /tf/cache/0cab8640-2d02-43ac-90d1-2f1c8100c979 (No space left on device) com.google.devtools.build.lib.remote.common.BulkTransferException: /tf/cache/0cab8640-2d02-43ac-90d1-2f1c8100c979 (No space left on device) at com.google.devtools.build.lib.remote.util.RxUtils$BulkTransferExceptionCollector.onResult(RxUtils.java:91) at io.reactivex.rxjava3.internal.operators.flowable.FlowableCollectSingle$CollectSubscriber.onNext(FlowableCollectSingle.java:94) at io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMapSingle$FlatMapSingleSubscriber.innerSuccess(FlowableFlatMapSingle.java:173) at io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMapSingle$FlatMapSingleSubscriber$InnerObserver.onSuccess(FlowableFlatMapSingle.java:342) at io.reactivex.rxjava3.internal.operators.single.SingleDoFinally$DoFinallyObserver.onSuccess(SingleDoFinally.java:73) at io.reactivex.rxjava3.internal.observers.ResumeSingleObserver.onSuccess(ResumeSingleObserver.java:46) at io.reactivex.rxjava3.internal.operators.single.SingleJust.subscribeActual(SingleJust.java:30) at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855) at io.reactivex.rxjava3.internal.operators.single.SingleResumeNext$ResumeMainSingleObserver.onError(SingleResumeNext.java:80) at io.reactivex.rxjava3.internal.operators.completable.CompletableToSingle$ToSingle.onError(CompletableToSingle.java:73) at io.reactivex.rxjava3.internal.operators.completable.CompletableCreate$Emitter.tryOnError(CompletableCreate.java:91) at io.reactivex.rxjava3.internal.operators.completable.CompletableCreate$Emitter.onError(CompletableCreate.java:77) at com.google.devtools.build.lib.remote.util.RxFutures$OnceCompletableOnSubscribe$1.onFailure(RxFutures.java:102) at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1074) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.addListener(AbstractFuture.java:724) at com.google.common.util.concurrent.Futures.addCallback(Futures.java:1047) at com.google.devtools.build.lib.remote.util.RxFutures$OnceCompletableOnSubscribe.subscribe(RxFutures.java:80) at io.reactivex.rxjava3.internal.operators.completable.CompletableCreate.subscribeActual(CompletableCreate.java:40) at io.reactivex.rxjava3.core.Completable.subscribe(Completable.java:2859) at io.reactivex.rxjava3.internal.operators.completable.CompletableToSingle.subscribeActual(CompletableToSingle.java:37) at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855) at io.reactivex.rxjava3.internal.operators.single.SingleResumeNext.subscribeActual(SingleResumeNext.java:39) at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855) at io.reactivex.rxjava3.internal.operators.single.SingleDoFinally.subscribeActual(SingleDoFinally.java:44) at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855) at io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMapSingle$FlatMapSingleSubscriber.onNext(FlowableFlatMapSingle.java:131) at io.reactivex.rxjava3.internal.operators.single.SingleFlatMapPublisher$SingleFlatMapPublisherObserver.onNext(SingleFlatMapPublisher.java:107) at io.reactivex.rxjava3.internal.operators.flowable.FlowableFromIterable$IteratorSubscription.fastPath(FlowableFromIterable.java:185) at io.reactivex.rxjava3.internal.operators.flowable.FlowableFromIterable$BaseRangeSubscription.request(FlowableFromIterable.java:129) at io.reactivex.rxjava3.internal.subscriptions.SubscriptionHelper.deferredSetOnce(SubscriptionHelper.java:202) at io.reactivex.rxjava3.internal.operators.single.SingleFlatMapPublisher$SingleFlatMapPublisherObserver.onSubscribe(SingleFlatMapPublisher.java:102) at io.reactivex.rxjava3.internal.operators.flowable.FlowableFromIterable.subscribe(FlowableFromIterable.java:69) at io.reactivex.rxjava3.internal.operators.flowable.FlowableFromIterable.subscribeActual(FlowableFromIterable.java:47) at io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15917) at io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15863) at io.reactivex.rxjava3.internal.operators.single.SingleFlatMapPublisher$SingleFlatMapPublisherObserver.onSuccess(SingleFlatMapPublisher.java:96) at io.reactivex.rxjava3.internal.operators.single.SingleDoOnSuccess$DoOnSuccess.onSuccess(SingleDoOnSuccess.java:60) at io.reactivex.rxjava3.internal.operators.single.SingleDoOnDispose$DoOnDisposeObserver.onSuccess(SingleDoOnDispose.java:84) at io.reactivex.rxjava3.internal.operators.single.SingleDoOnError$DoOnError.onSuccess(SingleDoOnError.java:52) at io.reactivex.rxjava3.internal.operators.single.SingleDoOnSubscribe$DoOnSubscribeSingleObserver.onSuccess(SingleDoOnSubscribe.java:77) at io.reactivex.rxjava3.internal.operators.single.SingleCreate$Emitter.onSuccess(SingleCreate.java:68) at com.google.devtools.build.lib.remote.util.RxFutures$OnceSingleOnSubscribe$1.onSuccess(RxFutures.java:155) at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.ImmediateFuture.addListener(ImmediateFuture.java:47) at com.google.common.util.concurrent.Futures.addCallback(Futures.java:1047) at com.google.devtools.build.lib.remote.util.RxFutures$OnceSingleOnSubscribe.subscribe(RxFutures.java:150) at io.reactivex.rxjava3.internal.operators.single.SingleCreate.subscribeActual(SingleCreate.java:40) at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855) at io.reactivex.rxjava3.internal.operators.single.SingleDoOnSubscribe.subscribeActual(SingleDoOnSubscribe.java:41) at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855) at io.reactivex.rxjava3.internal.operators.single.SingleDoOnError.subscribeActual(SingleDoOnError.java:35) at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855) at io.reactivex.rxjava3.internal.operators.single.SingleDoOnDispose.subscribeActual(SingleDoOnDispose.java:38) at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855) at io.reactivex.rxjava3.internal.operators.single.SingleDoOnSuccess.subscribeActual(SingleDoOnSuccess.java:35) at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855) at io.reactivex.rxjava3.internal.operators.single.SingleFlatMapPublisher.subscribeActual(SingleFlatMapPublisher.java:59) at io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15917) at io.reactivex.rxjava3.internal.operators.flowable.FlowableFlatMapSingle.subscribeActual(FlowableFlatMapSingle.java:53) at io.reactivex.rxjava3.core.Flowable.subscribe(Flowable.java:15917) at io.reactivex.rxjava3.internal.operators.flowable.FlowableCollectSingle.subscribeActual(FlowableCollectSingle.java:53) at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855) at io.reactivex.rxjava3.internal.operators.single.SingleFlatMapCompletable.subscribeActual(SingleFlatMapCompletable.java:44) at io.reactivex.rxjava3.core.Completable.subscribe(Completable.java:2859) at io.reactivex.rxjava3.internal.operators.completable.CompletableConcatArray$ConcatInnerObserver.next(CompletableConcatArray.java:89) at io.reactivex.rxjava3.internal.operators.completable.CompletableConcatArray.subscribeActual(CompletableConcatArray.java:33) at io.reactivex.rxjava3.core.Completable.subscribe(Completable.java:2859) at io.reactivex.rxjava3.internal.operators.completable.CompletableToSingle.subscribeActual(CompletableToSingle.java:37) at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855) at io.reactivex.rxjava3.core.Single.blockingGet(Single.java:3644) at com.google.devtools.build.lib.remote.UploadManifest.upload(UploadManifest.java:355) at com.google.devtools.build.lib.remote.RemoteExecutionService.uploadOutputs(RemoteExecutionService.java:1317) at com.google.devtools.build.lib.remote.RemoteSpawnCache$1.store(RemoteSpawnCache.java:194) at com.google.devtools.build.lib.exec.AbstractSpawnStrategy.exec(AbstractSpawnStrategy.java:151) at com.google.devtools.build.lib.exec.AbstractSpawnStrategy.exec(AbstractSpawnStrategy.java:108) at com.google.devtools.build.lib.actions.SpawnStrategy.beginExecution(SpawnStrategy.java:47) at com.google.devtools.build.lib.exec.SpawnStrategyResolver.beginExecution(SpawnStrategyResolver.java:68) at com.google.devtools.build.lib.rules.cpp.CppLinkAction.beginExecution(CppLinkAction.java:286) at com.google.devtools.build.lib.actions.Action.execute(Action.java:133) at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor$5.execute(SkyframeActionExecutor.java:907) at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor$ActionRunner.continueAction(SkyframeActionExecutor.java:1076) at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor$ActionRunner.run(SkyframeActionExecutor.java:1031) at com.google.devtools.build.lib.skyframe.ActionExecutionState.runStateMachine(ActionExecutionState.java:152) at com.google.devtools.build.lib.skyframe.ActionExecutionState.getResultOrDependOnFuture(ActionExecutionState.java:91) at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor.executeAction(SkyframeActionExecutor.java:492) at com.google.devtools.build.lib.skyframe.ActionExecutionFunction.checkCacheAndExecuteIfNeeded(ActionExecutionFunction.java:856) at com.google.devtools.build.lib.skyframe.ActionExecutionFunction.computeInternal(ActionExecutionFunction.java:349) at com.google.devtools.build.lib.skyframe.ActionExecutionFunction.compute(ActionExecutionFunction.java:169) at com.google.devtools.build.skyframe.AbstractParallelEvaluator$Evaluate.run(AbstractParallelEvaluator.java:590) at com.google.devtools.build.lib.concurrent.AbstractQueueVisitor$WrappedRunnable.run(AbstractQueueVisitor.java:382) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Suppressed: java.io.IOException: /tf/cache/0cab8640-2d02-43ac-90d1-2f1c8100c979 (No space left on device) at com.google.devtools.build.lib.unix.NativePosixFiles.openWrite(Native Method) at com.google.devtools.build.lib.unix.UnixFileSystem.createFileOutputStream(UnixFileSystem.java:493) at com.google.devtools.build.lib.vfs.AbstractFileSystem.getOutputStream(AbstractFileSystem.java:174) at com.google.devtools.build.lib.vfs.AbstractFileSystem.getOutputStream(AbstractFileSystem.java:188) at com.google.devtools.build.lib.vfs.Path.getOutputStream(Path.java:425) at com.google.devtools.build.lib.vfs.Path.getOutputStream(Path.java:413) at com.google.devtools.build.lib.remote.disk.DiskCacheClient.saveFile(DiskCacheClient.java:177) at com.google.devtools.build.lib.remote.disk.DiskCacheClient.uploadBlob(DiskCacheClient.java:143) at com.google.devtools.build.lib.remote.RemoteCache.lambda$uploadBlob$2(RemoteCache.java:174) at com.google.devtools.build.lib.remote.util.RxFutures$OnceCompletableOnSubscribe.subscribe(RxFutures.java:79) at io.reactivex.rxjava3.internal.operators.completable.CompletableCreate.subscribeActual(CompletableCreate.java:40) at io.reactivex.rxjava3.core.Completable.subscribe(Completable.java:2859) at io.reactivex.rxjava3.internal.operators.completable.CompletableToSingle.subscribeActual(CompletableToSingle.java:37) at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855) at com.google.devtools.build.lib.remote.util.AsyncTaskCache$Execution.subscribeActual(AsyncTaskCache.java:157) at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855) at com.google.devtools.build.lib.remote.util.AsyncTaskCache.lambda$execute$2(AsyncTaskCache.java:315) at io.reactivex.rxjava3.internal.operators.single.SingleCreate.subscribeActual(SingleCreate.java:40) at io.reactivex.rxjava3.core.Single.subscribe(Single.java:4855) at io.reactivex.rxjava3.internal.operators.completable.CompletableFromSingle.subscribeActual(CompletableFromSingle.java:29) at io.reactivex.rxjava3.core.Completable.subscribe(Completable.java:2859) at com.google.devtools.build.lib.remote.util.RxFutures.toListenableFuture(RxFutures.java:195) at com.google.devtools.build.lib.remote.RemoteCache.uploadBlob(RemoteCache.java:176) at com.google.devtools.build.lib.remote.UploadManifest.lambda$upload$1(UploadManifest.java:380) at com.google.devtools.build.lib.remote.util.RxFutures$OnceCompletableOnSubscribe.subscribe(RxFutures.java:79) ... 77 more java.util.logging.ErrorManager: 1 stderr_lines: <omitted> stdout: '' stdout_lines: <omitted> ...ignoring TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages] *** Friday 17 March 2023 01:56:54 +0000 (6:20:07.557) 7:46:45.554 ********** fatal: [localhost]: FAILED! => changed=false msg: 'The container "tf-py3.8" has been paused (409 Client Error for http+docker://localhost/v1.41/containers/tf-py3.8/exec: Conflict ("Container 9992ab147b31777ef2df8d716da0829ada3582fb3cd144595d90af81e7061a10 is not running"))' PLAY RECAP ********************************************************************* localhost : ok=34 changed=25 unreachable=0 failed=1 skipped=8 rescued=0 ignored=1 Friday 17 March 2023 01:56:59 +0000 (0:00:04.602) 7:46:50.157 ********** =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow git tests ------ 22807.56s tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 4966.68s tensorflow_in_container : (Python 3.8) build Python package ----------- 153.31s tensorflow : Fetch TensorFlow from git --------------------------------- 28.75s tensorflow_in_container : (Python 3.8) start build container ------------ 7.82s tensorflow : Remove TensorFlow git sources from previous build ---------- 7.06s tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build --- 4.63s tensorflow_in_container : (Python 3.8) collect list of installed Python packages --- 4.60s tensorflow_in_container : (Python 3.8) build Python versioned container --- 2.83s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 2.38s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 2.20s Gathering Facts --------------------------------------------------------- 2.15s Create cache dirs ------------------------------------------------------- 1.81s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 1.77s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 1.77s Cleanup after previous build -------------------------------------------- 1.65s tensorflow_in_container : (Python 3.8) cleanup Bazel install directory --- 1.53s tensorflow : Save git commit hash to file ------------------------------- 1.46s tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 1.02s tensorflow : Create readme file about unit tests ------------------------ 0.89s Build step 'Execute shell' marked build as failure

1 year, 2 months

1
1
0 0

Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #717

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/717/disp…> Changes: ------------------------------------------ [...truncated 21.77 KB...] TASK [tensorflow_in_container : (Python 3.8) create link for pip cache] ******** Tuesday 07 March 2023 18:10:54 +0000 (0:00:00.812) 0:00:49.753 ********* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build] *** Tuesday 07 March 2023 18:10:55 +0000 (0:00:00.829) 0:00:50.583 ********* changed: [localhost] TASK [tensorflow_in_container : Show list of installed Python packages for build] *** Tuesday 07 March 2023 18:10:57 +0000 (0:00:02.140) 0:00:52.724 ********* ok: [localhost] => pip_list_output.stdout: |- Package Version Location Installer ----------------------- -------------------- -------------------------------------- --------- absl-py 1.0.0 /usr/local/lib/python3.8/dist-packages pip astor 0.8.1 /usr/local/lib/python3.8/dist-packages pip astroid 2.11.7 /usr/local/lib/python3.8/dist-packages pip astunparse 1.6.3 /usr/local/lib/python3.8/dist-packages pip auditwheel 5.3.0 /usr/local/lib/python3.8/dist-packages pip bleach 6.0.0 /usr/local/lib/python3.8/dist-packages pip cachetools 5.3.0 /usr/local/lib/python3.8/dist-packages pip certifi 2019.11.28 /usr/lib/python3/dist-packages cffi 1.15.1 /usr/local/lib/python3.8/dist-packages pip chardet 3.0.4 /usr/lib/python3/dist-packages colorama 0.4.6 /usr/local/lib/python3.8/dist-packages pip cryptography 39.0.1 /usr/local/lib/python3.8/dist-packages pip Cython 0.29.33 /usr/local/lib/python3.8/dist-packages pip dbus-python 1.2.16 /usr/lib/python3/dist-packages dill 0.3.6 /usr/local/lib/python3.8/dist-packages pip docutils 0.19 /usr/local/lib/python3.8/dist-packages pip flatbuffers 2.0.7 /usr/local/lib/python3.8/dist-packages pip future 0.18.3 /usr/local/lib/python3.8/dist-packages pip gast 0.4.0 /usr/local/lib/python3.8/dist-packages pip google-auth 2.16.1 /usr/local/lib/python3.8/dist-packages pip google-auth-oauthlib 0.4.6 /usr/local/lib/python3.8/dist-packages pip google-pasta 0.2.0 /usr/local/lib/python3.8/dist-packages pip grpcio 1.49.1 /usr/local/lib/python3.8/dist-packages pip h5py 3.8.0 /usr/local/lib/python3.8/dist-packages pip idna 2.8 /usr/lib/python3/dist-packages importlib-metadata 6.0.0 /usr/local/lib/python3.8/dist-packages pip importlib-resources 5.12.0 /usr/local/lib/python3.8/dist-packages pip isort 5.12.0 /usr/local/lib/python3.8/dist-packages pip jaraco.classes 3.2.3 /usr/local/lib/python3.8/dist-packages pip jax 0.3.25 /usr/local/lib/python3.8/dist-packages pip jeepney 0.8.0 /usr/local/lib/python3.8/dist-packages pip junitparser 2.2.0 /usr/local/lib/python3.8/dist-packages pip Keras-Applications 1.0.8 /usr/local/lib/python3.8/dist-packages pip keras-nightly 2.13.0.dev2023022708 /usr/local/lib/python3.8/dist-packages pip Keras-Preprocessing 1.1.2 /usr/local/lib/python3.8/dist-packages pip keyring 23.13.1 /usr/local/lib/python3.8/dist-packages pip lazy-object-proxy 1.9.0 /usr/local/lib/python3.8/dist-packages pip lxml 4.9.2 /usr/local/lib/python3.8/dist-packages pip Markdown 3.4.1 /usr/local/lib/python3.8/dist-packages pip MarkupSafe 2.1.2 /usr/local/lib/python3.8/dist-packages pip mccabe 0.7.0 /usr/local/lib/python3.8/dist-packages pip more-itertools 9.0.0 /usr/local/lib/python3.8/dist-packages pip numpy 1.23.5 /usr/local/lib/python3.8/dist-packages pip oauthlib 3.2.2 /usr/local/lib/python3.8/dist-packages pip opt-einsum 3.3.0 /usr/local/lib/python3.8/dist-packages pip packaging 21.3 /usr/local/lib/python3.8/dist-packages pip pip 23.0.1 /usr/local/lib/python3.8/dist-packages pip pkginfo 1.9.6 /usr/local/lib/python3.8/dist-packages pip platformdirs 3.0.0 /usr/local/lib/python3.8/dist-packages pip portpicker 1.4.0 /usr/local/lib/python3.8/dist-packages pip protobuf 4.22.0 /usr/local/lib/python3.8/dist-packages pip pyasn1 0.4.8 /usr/local/lib/python3.8/dist-packages pip pyasn1-modules 0.2.8 /usr/local/lib/python3.8/dist-packages pip pycparser 2.21 /usr/local/lib/python3.8/dist-packages pip pyelftools 0.29 /usr/local/lib/python3.8/dist-packages pip Pygments 2.14.0 /usr/local/lib/python3.8/dist-packages pip PyGObject 3.36.0 /usr/lib/python3/dist-packages pylint 2.13.9 /usr/local/lib/python3.8/dist-packages pip pyparsing 3.0.9 /usr/local/lib/python3.8/dist-packages pip python-apt 2.0.1 /usr/lib/python3/dist-packages PyYAML 6.0 /usr/local/lib/python3.8/dist-packages pip readme-renderer 37.3 /usr/local/lib/python3.8/dist-packages pip requests 2.22.0 /usr/lib/python3/dist-packages requests-oauthlib 1.3.1 /usr/local/lib/python3.8/dist-packages pip requests-toolbelt 0.10.1 /usr/local/lib/python3.8/dist-packages pip requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages rfc3986 2.0.0 /usr/local/lib/python3.8/dist-packages pip rsa 4.9 /usr/local/lib/python3.8/dist-packages pip scipy 1.9.3 /usr/local/lib/python3.8/dist-packages pip SecretStorage 3.3.3 /usr/local/lib/python3.8/dist-packages pip setuptools 45.2.0 /usr/lib/python3/dist-packages six 1.15.0 /usr/local/lib/python3.8/dist-packages pip tb-nightly 2.13.0a20230226 /usr/local/lib/python3.8/dist-packages pip tensorboard-data-server 0.7.0 /usr/local/lib/python3.8/dist-packages pip tensorboard-plugin-wit 1.8.1 /usr/local/lib/python3.8/dist-packages pip termcolor 1.1.0 /usr/local/lib/python3.8/dist-packages pip tf-estimator-nightly 2.13.0.dev2023022709 /usr/local/lib/python3.8/dist-packages pip tomli 2.0.1 /usr/local/lib/python3.8/dist-packages pip tqdm 4.64.1 /usr/local/lib/python3.8/dist-packages pip twine 3.6.0 /usr/local/lib/python3.8/dist-packages pip typing-extensions 3.7.4.3 /usr/local/lib/python3.8/dist-packages pip urllib3 1.25.8 /usr/lib/python3/dist-packages webencodings 0.5.1 /usr/local/lib/python3.8/dist-packages pip Werkzeug 2.2.3 /usr/local/lib/python3.8/dist-packages pip wheel 0.38.4 /usr/local/lib/python3.8/dist-packages pip wrapt 1.12.1 /usr/local/lib/python3.8/dist-packages pip zipp 3.14.0 /usr/local/lib/python3.8/dist-packages pip TASK [tensorflow_in_container : (Python 3.8) build TensorFlow git] ************* Tuesday 07 March 2023 18:10:57 +0000 (0:00:00.046) 0:00:52.770 ********* fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- Extracting Bazel installation... Starting local Bazel server and connecting to it... INFO: Invocation ID: 3d57f278-65ce-4834-b25a-aef170e22300 INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Reading rc options for 'build' from /usertools/aarch64.bazelrc: 'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/local/bin/python3 --python_path=/usr/local/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --distinct_host_configuration=false --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3 INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64.bazelrc: --disk_cache=/tf/cache INFO: Found applicable config definition build:ambe in file /usertools/aarch64.bazelrc: --distinct_host_configuration=false --flaky_test_attempts=3 --action_env=PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin --host_crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --extra_toolchains=@ml2014_aarch64_config_aarch64//crosstool:toolchain-linux-aarch64 --extra_execution_platforms=@ml2014_aarch64_config_aarch64_platform//:platform --host_platform=@ml2014_aarch64_config_aarch64_platform//:platform --platforms=@ml2014_aarch64_config_aarch64_platform//:platform --repo_env=TF_PYTHON_CONFIG_REPO=@ml2014_aarch64_config_python INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/tensorflow/… failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-p… failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured) Analyzing: target //tensorflow/tools/pip_package:build_pip_package (290 packages loaded, 4320 targets configured) INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (592 packages loaded, 33871 targets configured). INFO: Found 1 target... [0 / 186] [Prepa] Creating source manifest for //tensorflow/python/tools:freeze_graph ... (33 actions, 0 running) [10,966 / 23,540] Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local, remote-cache ... (111 actions, 110 running) [11,037 / 23,540] Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local, remote-cache ... (111 actions, 110 running) [11,150 / 23,540] Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local, remote-cache ... (111 actions, 110 running) [11,228 / 23,540] Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 47s local, remote-cache ... (111 actions, 110 running) [11,506 / 23,540] Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 65s local, remote-cache ... (111 actions, 110 running) [11,814 / 23,540] Compiling tensorflow/compiler/tf2xla/ops/xla_ops.cc; 12s local, remote-cache ... (111 actions, 110 running) [12,004 / 23,540] Compiling tensorflow/core/kernels/set_kernels.cc; 35s local, remote-cache ... (111 actions, 110 running) [12,205 / 23,540] Compiling tensorflow/core/kernels/padding_fifo_queue.cc; 27s local, remote-cache ... (111 actions, 110 running) [12,427 / 23,540] Compiling tensorflow/core/kernels/padding_fifo_queue.cc; 58s local, remote-cache ... (111 actions, 110 running) [12,653 / 23,540] Compiling tensorflow/core/kernels/lrn_op.cc; 47s local, remote-cache ... (111 actions, 110 running) [13,473 / 23,540] Compiling tensorflow/core/kernels/bias_op.cc; 53s local, remote-cache ... (111 actions, 110 running) [13,701 / 23,540] Compiling tensorflow/core/kernels/training_ops.cc; 97s local, remote-cache ... (111 actions, 110 running) [14,097 / 23,540] Compiling tensorflow/core/kernels/training_ops.cc; 152s local, remote-cache ... (111 actions, 110 running) [14,526 / 23,540] Compiling tensorflow/core/kernels/rnn/lstm_ops.cc; 38s local, remote-cache ... (111 actions, 110 running) [15,194 / 23,540] Compiling tensorflow/core/util/batch_util.cc; 31s local, remote-cache ... (111 actions, 110 running) [16,155 / 23,612] Compiling tensorflow/core/util/batch_util.cc; 115s local, remote-cache ... (111 actions, 110 running) [16,623 / 23,612] Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 40s local, remote-cache ... (111 actions, 110 running) [17,282 / 23,612] Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 54s local, remote-cache ... (111 actions, 110 running) [19,468 / 23,612] Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 56s local, remote-cache ... (111 actions, 110 running) [20,133 / 23,612] Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 145s local, remote-cache ... (111 actions, 110 running) [20,768 / 23,612] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops.cc; 147s local, remote-cache ... (111 actions, 110 running) [21,075 / 23,612] Compiling tensorflow/core/kernels/matmul_op_real.cc; 260s local, remote-cache ... (111 actions, 110 running) [21,786 / 23,612] Compiling tensorflow/core/kernels/conv_grad_ops_3d.cc; 336s local, remote-cache ... (111 actions, 110 running) [22,841 / 23,612] Compiling stablehlo/dialect/StablehloOps.cpp; 82s local, remote-cache ... (111 actions, 110 running) [23,533 / 23,612] Compiling tensorflow/compiler/mlir/lite/ir/tfl_ops.cc; 192s local, remote-cache ... (14 actions running) [23,546 / 23,612] Linking tensorflow/libtensorflow_cc.so.2.13.0; 232s local, remote-cache [23,546 / 23,612] Linking tensorflow/libtensorflow_cc.so.2.13.0; 620s local, remote-cache ERROR: /tf/tensorflow/tensorflow/BUILD:1635:19: Executing genrule //tensorflow:tf_python_api_gen_v2 failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped) Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/tools/api/generator/create_python_api.py", line 22, in <module> from tensorflow.python.tools.api.generator import doc_srcs File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/__init__.py", line 42, in <module> from tensorflow.python import data File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/__init__.py", line 21, in <module> from tensorflow.python.data import experimental File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/experimental/__init__.py", line 97, in <module> from tensorflow.python.data.experimental import service File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/experimental/service/__init__.py", line 419, in <module> from tensorflow.python.data.experimental.ops.data_service_ops import distribute File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/experimental/ops/data_service_ops.py", line 22, in <module> from tensorflow.python.data.experimental.ops import compression_ops File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/experimental/ops/compression_ops.py", line 16, in <module> from tensorflow.python.data.util import structure File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/util/structure.py", line 30, in <module> from tensorflow.python.ops import resource_variable_ops File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/ops/resource_variable_ops.py", line 41, in <module> from tensorflow.python.framework import meta_graph File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/framework/meta_graph.py", line 34, in <module> from tensorflow.python.framework import importer File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/framework/importer.py", line 24, in <module> from tensorflow.python.framework import function File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/framework/function.py", line 34, in <module> from tensorflow.python.ops import variable_scope as vs File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/ops/variable_scope.py", line 25, in <module> from tensorflow.python.client import session File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/client/session.py", line 37, in <module> from tensorflow.python.ops import session_ops File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/ops/session_ops.py", line 27, in <module> from tensorflow.python.ops import gen_data_flow_ops File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/ops/gen_data_flow_ops.py", line 726, in <module> def dynamic_stitch(indices: list[_atypes.TensorFuzzingAnnotation[_atypes.Int32]], data: list[_atypes.TensorFuzzingAnnotation[TV_DynamicStitch_T]], name=None) -> _atypes.TensorFuzzingAnnotation[TV_DynamicStitch_T]: TypeError: 'type' object is not subscriptable Target //tensorflow/tools/pip_package:build_pip_package failed to build Use --verbose_failures to see the command lines of failed build steps. ERROR: /tf/tensorflow/tensorflow/lite/python/BUILD:72:10 Middleman _middlemen/tensorflow_Slite_Spython_Stflite_Uconvert-runfiles failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped) INFO: Elapsed time: 2996.839s, Critical Path: 1275.76s INFO: 23611 processes: 9505 disk cache hit, 5556 internal, 8550 local. FAILED: Build did NOT complete successfully FAILED: Build did NOT complete successfully stderr_lines: <omitted> stdout: '' stdout_lines: <omitted> PLAY RECAP ********************************************************************* localhost : ok=29 changed=21 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0 Tuesday 07 March 2023 19:00:55 +0000 (0:49:58.121) 0:50:50.891 ********* =============================================================================== tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 2998.12s tensorflow : Fetch TensorFlow from git --------------------------------- 24.03s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.91s tensorflow_in_container : (Python 3.8) start build container ------------ 3.88s Gathering Facts --------------------------------------------------------- 2.67s tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build --- 2.14s tensorflow_in_container : (Python 3.8) build Python versioned container --- 1.51s Create cache dirs ------------------------------------------------------- 1.38s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.19s tensorflow : Save git commit hash to file ------------------------------- 1.11s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.84s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.83s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.81s tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.75s tensorflow : Create readme file about unit tests ------------------------ 0.70s tensorflow : Create linklibs shell script ------------------------------- 0.69s Build TensorFlow for each Python version (dual abi) --------------------- 0.66s tensorflow_in_container : Reset checkout to clean state ----------------- 0.63s tensorflow : Get oneline version of git log for this checkout ----------- 0.61s Build step 'Execute shell' marked build as failure

1 year, 2 months

1
2
0 0

Build failed in Jenkins: Tensorflow oneDNN Python package (manylinux2014 nightly) #361

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/3…> Changes: ------------------------------------------ [...truncated 22.15 KB...] TASK [tensorflow_in_container : (Python 3.8) create link for pip cache] ******** Wednesday 08 March 2023 01:56:50 +0000 (0:00:00.809) 0:00:45.973 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build] *** Wednesday 08 March 2023 01:56:51 +0000 (0:00:00.803) 0:00:46.777 ******* changed: [localhost] TASK [tensorflow_in_container : Show list of installed Python packages for build] *** Wednesday 08 March 2023 01:56:53 +0000 (0:00:02.012) 0:00:48.789 ******* ok: [localhost] => pip_list_output.stdout: |- Package Version Location Installer ----------------------- -------------------- -------------------------------------- --------- absl-py 1.0.0 /usr/local/lib/python3.8/dist-packages pip astor 0.8.1 /usr/local/lib/python3.8/dist-packages pip astroid 2.11.7 /usr/local/lib/python3.8/dist-packages pip astunparse 1.6.3 /usr/local/lib/python3.8/dist-packages pip auditwheel 5.3.0 /usr/local/lib/python3.8/dist-packages pip bleach 6.0.0 /usr/local/lib/python3.8/dist-packages pip cachetools 5.3.0 /usr/local/lib/python3.8/dist-packages pip certifi 2019.11.28 /usr/lib/python3/dist-packages cffi 1.15.1 /usr/local/lib/python3.8/dist-packages pip chardet 3.0.4 /usr/lib/python3/dist-packages colorama 0.4.6 /usr/local/lib/python3.8/dist-packages pip cryptography 39.0.1 /usr/local/lib/python3.8/dist-packages pip Cython 0.29.33 /usr/local/lib/python3.8/dist-packages pip dbus-python 1.2.16 /usr/lib/python3/dist-packages dill 0.3.6 /usr/local/lib/python3.8/dist-packages pip docutils 0.19 /usr/local/lib/python3.8/dist-packages pip flatbuffers 2.0.7 /usr/local/lib/python3.8/dist-packages pip future 0.18.3 /usr/local/lib/python3.8/dist-packages pip gast 0.4.0 /usr/local/lib/python3.8/dist-packages pip google-auth 2.16.2 /usr/local/lib/python3.8/dist-packages pip google-auth-oauthlib 0.4.6 /usr/local/lib/python3.8/dist-packages pip google-pasta 0.2.0 /usr/local/lib/python3.8/dist-packages pip grpcio 1.49.1 /usr/local/lib/python3.8/dist-packages pip h5py 3.8.0 /usr/local/lib/python3.8/dist-packages pip idna 2.8 /usr/lib/python3/dist-packages importlib-metadata 6.0.0 /usr/local/lib/python3.8/dist-packages pip importlib-resources 5.12.0 /usr/local/lib/python3.8/dist-packages pip isort 5.12.0 /usr/local/lib/python3.8/dist-packages pip jaraco.classes 3.2.3 /usr/local/lib/python3.8/dist-packages pip jax 0.3.25 /usr/local/lib/python3.8/dist-packages pip jeepney 0.8.0 /usr/local/lib/python3.8/dist-packages pip junitparser 2.2.0 /usr/local/lib/python3.8/dist-packages pip Keras-Applications 1.0.8 /usr/local/lib/python3.8/dist-packages pip keras-nightly 2.13.0.dev2023030308 /usr/local/lib/python3.8/dist-packages pip Keras-Preprocessing 1.1.2 /usr/local/lib/python3.8/dist-packages pip keyring 23.13.1 /usr/local/lib/python3.8/dist-packages pip lazy-object-proxy 1.9.0 /usr/local/lib/python3.8/dist-packages pip lxml 4.9.2 /usr/local/lib/python3.8/dist-packages pip Markdown 3.4.1 /usr/local/lib/python3.8/dist-packages pip MarkupSafe 2.1.2 /usr/local/lib/python3.8/dist-packages pip mccabe 0.7.0 /usr/local/lib/python3.8/dist-packages pip more-itertools 9.0.0 /usr/local/lib/python3.8/dist-packages pip numpy 1.23.5 /usr/local/lib/python3.8/dist-packages pip oauthlib 3.2.2 /usr/local/lib/python3.8/dist-packages pip opt-einsum 3.3.0 /usr/local/lib/python3.8/dist-packages pip packaging 21.3 /usr/local/lib/python3.8/dist-packages pip pip 23.0.1 /usr/local/lib/python3.8/dist-packages pip pkginfo 1.9.6 /usr/local/lib/python3.8/dist-packages pip platformdirs 3.0.0 /usr/local/lib/python3.8/dist-packages pip portpicker 1.4.0 /usr/local/lib/python3.8/dist-packages pip protobuf 4.22.0 /usr/local/lib/python3.8/dist-packages pip pyasn1 0.4.8 /usr/local/lib/python3.8/dist-packages pip pyasn1-modules 0.2.8 /usr/local/lib/python3.8/dist-packages pip pycparser 2.21 /usr/local/lib/python3.8/dist-packages pip pyelftools 0.29 /usr/local/lib/python3.8/dist-packages pip Pygments 2.14.0 /usr/local/lib/python3.8/dist-packages pip PyGObject 3.36.0 /usr/lib/python3/dist-packages pylint 2.13.9 /usr/local/lib/python3.8/dist-packages pip pyparsing 3.0.9 /usr/local/lib/python3.8/dist-packages pip python-apt 2.0.1 /usr/lib/python3/dist-packages PyYAML 6.0 /usr/local/lib/python3.8/dist-packages pip readme-renderer 37.3 /usr/local/lib/python3.8/dist-packages pip requests 2.22.0 /usr/lib/python3/dist-packages requests-oauthlib 1.3.1 /usr/local/lib/python3.8/dist-packages pip requests-toolbelt 0.10.1 /usr/local/lib/python3.8/dist-packages pip requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages rfc3986 2.0.0 /usr/local/lib/python3.8/dist-packages pip rsa 4.9 /usr/local/lib/python3.8/dist-packages pip scipy 1.9.3 /usr/local/lib/python3.8/dist-packages pip SecretStorage 3.3.3 /usr/local/lib/python3.8/dist-packages pip setuptools 45.2.0 /usr/lib/python3/dist-packages six 1.15.0 /usr/local/lib/python3.8/dist-packages pip tb-nightly 2.13.0a20230303 /usr/local/lib/python3.8/dist-packages pip tensorboard-data-server 0.7.0 /usr/local/lib/python3.8/dist-packages pip tensorboard-plugin-wit 1.8.1 /usr/local/lib/python3.8/dist-packages pip termcolor 1.1.0 /usr/local/lib/python3.8/dist-packages pip tf-estimator-nightly 2.13.0.dev2023030309 /usr/local/lib/python3.8/dist-packages pip tomli 2.0.1 /usr/local/lib/python3.8/dist-packages pip tqdm 4.64.1 /usr/local/lib/python3.8/dist-packages pip twine 3.6.0 /usr/local/lib/python3.8/dist-packages pip typing-extensions 3.7.4.3 /usr/local/lib/python3.8/dist-packages pip urllib3 1.25.8 /usr/lib/python3/dist-packages webencodings 0.5.1 /usr/local/lib/python3.8/dist-packages pip Werkzeug 2.2.3 /usr/local/lib/python3.8/dist-packages pip wheel 0.38.4 /usr/local/lib/python3.8/dist-packages pip wrapt 1.12.1 /usr/local/lib/python3.8/dist-packages pip zipp 3.14.0 /usr/local/lib/python3.8/dist-packages pip TASK [tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git] *** Wednesday 08 March 2023 01:56:53 +0000 (0:00:00.047) 0:00:48.836 ******* fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- Extracting Bazel installation... Starting local Bazel server and connecting to it... INFO: Invocation ID: f881e1d1-e998-4247-bb3f-dd72a52a247b INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Reading rc options for 'build' from /usertools/aarch64.bazelrc: 'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/local/bin/python3 --python_path=/usr/local/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --distinct_host_configuration=false --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3 INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64.bazelrc: --disk_cache=/tf/cache INFO: Found applicable config definition build:ambe in file /usertools/aarch64.bazelrc: --distinct_host_configuration=false --flaky_test_attempts=3 --action_env=PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin --host_crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --extra_toolchains=@ml2014_aarch64_config_aarch64//crosstool:toolchain-linux-aarch64 --extra_execution_platforms=@ml2014_aarch64_config_aarch64_platform//:platform --host_platform=@ml2014_aarch64_config_aarch64_platform//:platform --platforms=@ml2014_aarch64_config_aarch64_platform//:platform --repo_env=TF_PYTHON_CONFIG_REPO=@ml2014_aarch64_config_python INFO: Found applicable config definition build:mkl_aarch64_threadpool in file /tf/tensorflow/.bazelrc: --define=build_with_mkl_aarch64=true -c opt INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/tensorflow/… failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-p… failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured) Analyzing: target //tensorflow/tools/pip_package:build_pip_package (288 packages loaded, 4267 targets configured) WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/openxla/sta… failed: class java.io.FileNotFoundException GET returned 404 Not Found INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (595 packages loaded, 37117 targets configured). INFO: Found 1 target... [0 / 174] [Prepa] Expanding template tensorflow/python/debug/lib/grpc_tensorflow_server ... (12 actions, 0 running) [766 / 2,086] Compiling llvm/lib/Support/APFloat.cpp; 9s local, remote-cache ... (110 actions, 108 running) [961 / 2,086] Compiling llvm/utils/TableGen/CodeGenRegisters.cpp; 20s local, remote-cache ... (111 actions, 110 running) [3,293 / 5,035] Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp; 32s local, remote-cache ... (111 actions, 110 running) [3,470 / 5,035] Compiling tensorflow/tsl/profiler/utils/xplane_builder.cc; 9s local, remote-cache ... (109 actions, 108 running) [5,066 / 7,212] Compiling tensorflow/compiler/xla/stream_executor/stream.cc; 24s local, remote-cache ... (111 actions, 110 running) [6,006 / 7,810] Compiling tensorflow/compiler/xla/stream_executor/stream.cc; 15s local, remote-cache ... (111 actions, 110 running) [6,174 / 7,810] Compiling mlir/lib/IR/BuiltinAttributes.cpp; 26s local, remote-cache ... (111 actions, 110 running) [6,442 / 7,898] Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local, remote-cache ... (111 actions, 110 running) [7,144 / 8,672] Compiling tensorflow/core/ir/ops.cc; 51s local, remote-cache ... (111 actions, 110 running) [7,477 / 8,796] Compiling tensorflow/compiler/xla/literal.cc; 42s local, remote-cache ... (111 actions, 110 running) [7,737 / 8,796] Compiling tensorflow/core/util/batch_util.cc; 61s local, remote-cache ... (111 actions, 110 running) [8,032 / 8,796] Compiling tensorflow/core/util/batch_util.cc; 108s local, remote-cache ... (111 actions, 110 running) [8,358 / 8,796] Compiling tensorflow/core/util/batch_util.cc; 29s local, remote-cache ... (111 actions, 110 running) [9,971 / 10,300] Compiling tensorflow/lite/kernels/fully_connected.cc; 24s local, remote-cache ... (111 actions, 110 running) [11,385 / 11,677] Compiling tensorflow/core/transforms/constant_folding/pass.cc; 46s local, remote-cache ... (111 actions, 110 running) [14,211 / 16,349] Compiling tensorflow/core/kernels/image/colorspace_op.cc; 38s local, remote-cache ... (111 actions, 110 running) [14,845 / 16,913] Compiling tensorflow/core/kernels/linalg/svd_op_complex128.cc; 125s local, remote-cache ... (111 actions, 110 running) [15,182 / 17,273] Compiling tensorflow/core/kernels/linalg/matrix_square_root_op.cc; 228s local, remote-cache ... (111 actions, 110 running) [15,683 / 17,679] Compiling tensorflow/compiler/mlir/lite/ir/tfl_ops.cc; 139s local, remote-cache ... (111 actions, 110 running) [16,706 / 18,416] Compiling tensorflow/core/kernels/broadcast_to_op.cc; 138s local, remote-cache ... (111 actions, 110 running) [17,318 / 18,868] Compiling tensorflow/compiler/xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 170s local, remote-cache ... (111 actions, 110 running) [18,684 / 19,983] Compiling tensorflow/core/kernels/cwise_op_select.cc; 282s local, remote-cache ... (111 actions, 110 running) [19,809 / 20,973] Compiling tensorflow/core/kernels/matmul_op_real.cc; 348s local, remote-cache ... (111 actions, 110 running) [22,216 / 23,113] Compiling tensorflow/core/kernels/mkl/mkl_cwise_ops_common.cc; 182s local, remote-cache ... (111 actions, 110 running) [24,254 / 24,668] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops_a_m.cc; 180s local, remote-cache ... (111 actions, 110 running) [24,644 / 24,710] Linking tensorflow/libtensorflow_cc.so.2.13.0; 201s local, remote-cache ERROR: /tf/tensorflow/tensorflow/BUILD:1635:19: Executing genrule //tensorflow:tf_python_api_gen_v2 failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped) Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/tools/api/generator/create_python_api.py", line 22, in <module> from tensorflow.python.tools.api.generator import doc_srcs File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/__init__.py", line 42, in <module> from tensorflow.python import data File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/__init__.py", line 21, in <module> from tensorflow.python.data import experimental File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/experimental/__init__.py", line 97, in <module> from tensorflow.python.data.experimental import service File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/experimental/service/__init__.py", line 419, in <module> from tensorflow.python.data.experimental.ops.data_service_ops import distribute File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/experimental/ops/data_service_ops.py", line 22, in <module> from tensorflow.python.data.experimental.ops import compression_ops File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/experimental/ops/compression_ops.py", line 16, in <module> from tensorflow.python.data.util import structure File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/data/util/structure.py", line 30, in <module> from tensorflow.python.ops import resource_variable_ops File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/ops/resource_variable_ops.py", line 41, in <module> from tensorflow.python.framework import meta_graph File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/framework/meta_graph.py", line 34, in <module> from tensorflow.python.framework import importer File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/framework/importer.py", line 24, in <module> from tensorflow.python.framework import function File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/framework/function.py", line 34, in <module> from tensorflow.python.ops import variable_scope as vs File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/ops/variable_scope.py", line 25, in <module> from tensorflow.python.client import session File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/client/session.py", line 38, in <module> from tensorflow.python.ops import session_ops File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/ops/session_ops.py", line 27, in <module> from tensorflow.python.ops import gen_data_flow_ops File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/ops/gen_data_flow_ops.py", line 726, in <module> def dynamic_stitch(indices: list[_atypes.TensorFuzzingAnnotation[_atypes.Int32]], data: list[_atypes.TensorFuzzingAnnotation[TV_DynamicStitch_T]], name=None) -> _atypes.TensorFuzzingAnnotation[TV_DynamicStitch_T]: TypeError: 'type' object is not subscriptable Target //tensorflow/tools/pip_package:build_pip_package failed to build Use --verbose_failures to see the command lines of failed build steps. ERROR: /tf/tensorflow/tensorflow/python/tools/BUILD:282:10 Middleman _middlemen/tensorflow_Spython_Stools_Sprint_Uselective_Uregistration_Uheader-runfiles failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped) INFO: Elapsed time: 2891.378s, Critical Path: 1109.12s INFO: 24709 processes: 10076 disk cache hit, 5612 internal, 9021 local. FAILED: Build did NOT complete successfully FAILED: Build did NOT complete successfully stderr_lines: <omitted> stdout: '' stdout_lines: <omitted> PLAY RECAP ********************************************************************* localhost : ok=29 changed=21 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0 Wednesday 08 March 2023 02:45:05 +0000 (0:48:12.561) 0:49:01.398 ******* =============================================================================== tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git 2892.56s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 21.39s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.87s tensorflow_in_container : (Python 3.8) start build container ------------ 3.86s tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build --- 2.01s Gathering Facts --------------------------------------------------------- 1.62s tensorflow_in_container : (Python 3.8) build Python versioned container --- 1.51s Create cache dirs ------------------------------------------------------- 1.38s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.20s tensorflow : Save git commit hash to file ------------------------------- 1.11s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.83s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.81s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.80s tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.72s tensorflow : Create readme file about unit tests ------------------------ 0.70s tensorflow : Create linklibs shell script ------------------------------- 0.69s Build TensorFlow for each Python version (dual abi) --------------------- 0.64s tensorflow_in_container : Reset checkout to clean state ----------------- 0.64s tensorflow : Get oneline version of git log for this checkout ----------- 0.59s Build step 'Execute shell' marked build as failure

1 year, 2 months

1
1
0 0

Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #709

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/709/disp…> Changes: ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on ldcg-aarch64-02 (aarch64 leg-aarch64) in workspace <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/> [ldcg-python-manylinux-tensorflow-nightly] $ /bin/bash /tmp/jenkins5574223505825888602.sh + dual_abi=false + cd <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/> + rm -rf '*.sh' configs wheels cache_upload + mkdir wheels cache_upload + git clone --depth 1 https://git.linaro.org/ci/job/configs.git Cloning into 'configs'... + cd configs + git log --pretty=oneline -1 4589cc3ca8c2e214a46c15ea9c7ba36c630b2bc6 tcwg_bmk: Set cflags configuration based on PROFILE name + cd .. + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' true = true ']' + echo ' - "git"' + dual_abi=true + '[' false = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' true == true ']' + ansible-galaxy collection install community.docker Starting galaxy collection install process Nothing to do. All requested collections are already installed. If you want to reinstall them, consider using `--force`. + cd configs/ldcg-python-manylinux-tensorflow/ansible/ + sed -i -es+/tmp/workspace+<https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/+g> vars/vars.yml + ansible-playbook playbooks/build-tf-dual-abi.yml [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' PLAY [Build TensorFlow in Dual ABI container] ********************************** TASK [Gathering Facts] ********************************************************* Thursday 02 March 2023 18:10:04 +0000 (0:00:00.062) 0:00:00.062 ******** ok: [localhost] TASK [Cleanup after previous build] ******************************************** Thursday 02 March 2023 18:10:06 +0000 (0:00:01.642) 0:00:01.705 ******** changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels) ok: [localhost] => (item=tensorflow) TASK [Create cache dirs] ******************************************************* Thursday 02 March 2023 18:10:07 +0000 (0:00:01.278) 0:00:02.984 ******** ok: [localhost] => (item=disk-cache) ok: [localhost] => (item=bazel-cache) changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels) TASK [Set dual abi variable] *************************************************** Thursday 02 March 2023 18:10:08 +0000 (0:00:01.384) 0:00:04.368 ******** ok: [localhost] TASK [Go through each TensorFlow version] ************************************** Thursday 02 March 2023 18:10:08 +0000 (0:00:00.038) 0:00:04.406 ******** skipping: [localhost] => (item={'key': '2.12', 'value': {'tensorflow_version': '2.12.0-rc0', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.12.0rc0', 'tensorboard_version': '==2.12.0', 'tensorflow_estimator_version': '==2.12.0rc0', 'image_prefix': '2.12', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/core/platform:ram_file_system_test', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/compiler/xla:xla_test_cpu', '//tensorflow/python/data/experimental/kernel_tests:checkpoint_input_pipeline_hook_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/distribute:parameter_server_strategy_test_cpu', '//tensorflow/python/distribute:parameter_server_strategy_test_2gpu', '//tensorflow/python/kernel_tests/linalg:matrix_triangular_solve_op_test', '//tensorflow/python/training:server_lib_test', '//tensorflow/tsl/framework/convolution:spatial_convolutions_test'], 'serial_unit_tests_exclude': ['//tensorflow/python/debug/lib:source_remote_test'], 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-no_oss_py38,-no_oss_py39,-no_oss_py310', 'python_versions': ['3.8', '3.9', '3.10', '3.11']}}) skipping: [localhost] => (item={'key': '2.11', 'value': {'tensorflow_version': '2.11.0', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.11.0', 'tensorboard_version': '==2.11.2', 'tensorflow_estimator_version': '==2.11.0', 'image_prefix': '', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/training:server_lib_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.10', 'value': {'tensorflow_version': '2.10.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.10.0', 'tensorboard_version': '==2.10.1', 'tensorflow_estimator_version': '==2.10.0', 'image_prefix': '', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tensorflow/tests/...', '//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/tests:jit_test_cpu', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/training:server_lib_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.9', 'value': {'tensorflow_version': '2.9.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.9.0', 'tensorboard_version': '==2.9.0', 'tensorflow_estimator_version': '==2.9.0', 'image_prefix': '', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.8', 'value': {'tensorflow_version': '2.8.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.8.0', 'tensorboard_version': '==2.8.0', 'tensorflow_estimator_version': '==2.8.0', 'image_prefix': '', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/mlir/lite/tests:prepare-tf.mlir.test', '//tensorflow/compiler/mlir/tensorflow:dump_graph_test', '//tensorflow/core/common_runtime:direct_session_test', '//tensorflow/core/common_runtime:direct_session_with_debug_test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:quantize_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python:quantized_ops_test', '//tensorflow/python:script_ops_test', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.7', 'value': {'tensorflow_version': '2.7.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.5', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.7.0', 'tensorboard_version': '==2.7.0', 'tensorflow_estimator_version': '==2.7.0', 'image_prefix': '', 'python_install_packages': ['portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/java/...', '//tensorflow/lite/...', '//tensorflow/compiler/xla/python/...', '//tensorflow/compiler/xla/service/cpu/...', '//tensorflow/compiler/xla/tests/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/core/kernels:sparse_matmul_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/debug/cli:debugger_cli_common_test', '//tensorflow/python/debug/examples/v2:examples_v2_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/keras/mixed_precision:model_test', '//tensorflow/python/keras/preprocessing:image_test', '//tensorflow/python/kernel_tests:init_ops_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests:self_adjoint_eig_op_test', '//tensorflow/python/kernel_tests:sparse_matmul_op_test', '//tensorflow/python/lib/io:file_io_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python/ops/ragged:ragged_print_op_test', '//tensorflow/python/profiler/integration_test:profiler_api_test', '//tensorflow/python/profiler:profiler_v2_test', '//tensorflow/python/util:dispatch_test', '//tensorflow/python/util:traceback_utils_test', '//tensorflow/tools/api/tests:api_compatibility_test', '//tensorflow/tools/docs:tf_doctest', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.6', 'value': {'tensorflow_version': '2.6.5', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.6.0', 'tensorboard_version': '==2.6.0', 'tensorflow_estimator_version': '==2.6.0', 'image_prefix': '', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.5', 'value': {'tensorflow_version': '2.5.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.34.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.5.0', 'tensorboard_version': '==2.5.0', 'tensorflow_estimator_version': '==2.5.0', 'image_prefix': '', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.4', 'value': {'tensorflow_version': '2.4.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.3.3', 'grpcio_version': '~=1.32.0', 'h5py_version': '~=2.10', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.4.3', 'tensorboard_version': '==2.4.1', 'tensorflow_estimator_version': '==2.4.0', 'image_prefix': '', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '1.15', 'value': {'tensorflow_version': '1.15.5', 'bazel_version': '0.29.1', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.2.2', 'grpcio_version': '~=1.32.0', 'h5py_version': '==2.10', 'numpy_version': '~=1.18.0', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==1.2.2', 'tensorboard_version': '==1.15.0', 'tensorflow_estimator_version': '==1.15.2', 'image_prefix': '', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m']}}) TASK [tensorflow : Set TensorFlow and other package versions] ****************** Thursday 02 March 2023 18:10:09 +0000 (0:00:00.263) 0:00:04.670 ******** ok: [localhost] TASK [tensorflow : Set build dir for TensorFlow git] *************************** Thursday 02 March 2023 18:10:09 +0000 (0:00:00.087) 0:00:04.758 ******** ok: [localhost] TASK [tensorflow : Remove TensorFlow git sources from previous build] ********** Thursday 02 March 2023 18:10:09 +0000 (0:00:00.046) 0:00:04.805 ******** fatal: [localhost]: FAILED! => changed=false msg: 'rmtree failed: [Errno 13] Permission denied: ''tf_ci_cpu-2.13.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl''' PLAY RECAP ********************************************************************* localhost : ok=6 changed=2 unreachable=0 failed=1 skipped=0 rescued=0 ignored=0 Thursday 02 March 2023 18:10:12 +0000 (0:00:02.868) 0:00:07.673 ******** =============================================================================== tensorflow : Remove TensorFlow git sources from previous build ---------- 2.87s Gathering Facts --------------------------------------------------------- 1.64s Create cache dirs ------------------------------------------------------- 1.38s Cleanup after previous build -------------------------------------------- 1.28s Go through each TensorFlow version -------------------------------------- 0.26s tensorflow : Set TensorFlow and other package versions ------------------ 0.09s tensorflow : Set build dir for TensorFlow git --------------------------- 0.05s Set dual abi variable --------------------------------------------------- 0.04s Build step 'Execute shell' marked build as failure

1 year, 2 months

1
3
0 0

Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #706

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/706/disp…> Changes: ------------------------------------------ [...truncated 8.17 KB...] skipping: [localhost] => (item={'key': '2.8', 'value': {'tensorflow_version': '2.8.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.8.0', 'tensorboard_version': '==2.8.0', 'tensorflow_estimator_version': '==2.8.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/mlir/lite/tests:prepare-tf.mlir.test', '//tensorflow/compiler/mlir/tensorflow:dump_graph_test', '//tensorflow/core/common_runtime:direct_session_test', '//tensorflow/core/common_runtime:direct_session_with_debug_test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:quantize_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python:quantized_ops_test', '//tensorflow/python:script_ops_test', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.7', 'value': {'tensorflow_version': '2.7.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.5', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.7.0', 'tensorboard_version': '==2.7.0', 'tensorflow_estimator_version': '==2.7.0', 'python_install_packages': ['portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/java/...', '//tensorflow/lite/...', '//tensorflow/compiler/xla/python/...', '//tensorflow/compiler/xla/service/cpu/...', '//tensorflow/compiler/xla/tests/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/core/kernels:sparse_matmul_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/debug/cli:debugger_cli_common_test', '//tensorflow/python/debug/examples/v2:examples_v2_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/keras/mixed_precision:model_test', '//tensorflow/python/keras/preprocessing:image_test', '//tensorflow/python/kernel_tests:init_ops_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests:self_adjoint_eig_op_test', '//tensorflow/python/kernel_tests:sparse_matmul_op_test', '//tensorflow/python/lib/io:file_io_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python/ops/ragged:ragged_print_op_test', '//tensorflow/python/profiler/integration_test:profiler_api_test', '//tensorflow/python/profiler:profiler_v2_test', '//tensorflow/python/util:dispatch_test', '//tensorflow/python/util:traceback_utils_test', '//tensorflow/tools/api/tests:api_compatibility_test', '//tensorflow/tools/docs:tf_doctest', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.6', 'value': {'tensorflow_version': '2.6.5', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.6.0', 'tensorboard_version': '==2.6.0', 'tensorflow_estimator_version': '==2.6.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.5', 'value': {'tensorflow_version': '2.5.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.34.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.5.0', 'tensorboard_version': '==2.5.0', 'tensorflow_estimator_version': '==2.5.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.4', 'value': {'tensorflow_version': '2.4.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.3.3', 'grpcio_version': '~=1.32.0', 'h5py_version': '~=2.10', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.4.3', 'tensorboard_version': '==2.4.1', 'tensorflow_estimator_version': '==2.4.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '1.15', 'value': {'tensorflow_version': '1.15.5', 'bazel_version': '0.29.1', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.2.2', 'grpcio_version': '~=1.32.0', 'h5py_version': '==2.10', 'numpy_version': '~=1.18.0', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==1.2.2', 'tensorboard_version': '==1.15.0', 'tensorflow_estimator_version': '==1.15.2', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m']}}) TASK [tensorflow : Set TensorFlow and other package versions] ****************** Monday 27 February 2023 18:10:09 +0000 (0:00:00.257) 0:00:04.710 ******* ok: [localhost] TASK [tensorflow : Set build dir for TensorFlow git] *************************** Monday 27 February 2023 18:10:09 +0000 (0:00:00.083) 0:00:04.793 ******* ok: [localhost] TASK [tensorflow : Remove TensorFlow git sources from previous build] ********** Monday 27 February 2023 18:10:09 +0000 (0:00:00.047) 0:00:04.841 ******* changed: [localhost] TASK [tensorflow : Fetch TensorFlow] ******************************************* Monday 27 February 2023 18:10:13 +0000 (0:00:03.861) 0:00:08.702 ******* included: <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/confi…> for localhost TASK [tensorflow : Fetch TensorFlow git source] ******************************** Monday 27 February 2023 18:10:13 +0000 (0:00:00.116) 0:00:08.819 ******* skipping: [localhost] TASK [tensorflow : Unpack TensorFlow git source] ******************************* Monday 27 February 2023 18:10:13 +0000 (0:00:00.039) 0:00:08.859 ******* skipping: [localhost] TASK [tensorflow : Rename source dir for oneDNN build] ************************* Monday 27 February 2023 18:10:13 +0000 (0:00:00.038) 0:00:08.897 ******* skipping: [localhost] TASK [tensorflow : Fetch TensorFlow from git] ********************************** Monday 27 February 2023 18:10:13 +0000 (0:00:00.038) 0:00:08.936 ******* changed: [localhost] TASK [tensorflow : Fetch TensorFlow from git at commit] ************************ Monday 27 February 2023 18:10:36 +0000 (0:00:22.770) 0:00:31.706 ******* skipping: [localhost] TASK [tensorflow : Set world write access to source] *************************** Monday 27 February 2023 18:10:36 +0000 (0:00:00.036) 0:00:31.743 ******* changed: [localhost] TASK [tensorflow : Get oneline version of git log for this checkout] *********** Monday 27 February 2023 18:10:36 +0000 (0:00:00.375) 0:00:32.118 ******* changed: [localhost] TASK [tensorflow : Show git log] *********************************************** Monday 27 February 2023 18:10:37 +0000 (0:00:00.605) 0:00:32.724 ******* ok: [localhost] => git_log.stdout: 62a793ae3214ea6fdc41d780802b4c49d0270be1 Make inferReturnTypeComponentsFromOperands more resilient against cast failures. TASK [tensorflow : Record git commit hash to variable] ************************* Monday 27 February 2023 18:10:37 +0000 (0:00:00.044) 0:00:32.768 ******* ok: [localhost] TASK [tensorflow : Save git commit hash to file] ******************************* Monday 27 February 2023 18:10:37 +0000 (0:00:00.064) 0:00:32.833 ******* changed: [localhost] TASK [Build Bazel] ************************************************************* Monday 27 February 2023 18:10:38 +0000 (0:00:01.113) 0:00:33.947 ******* skipping: [localhost] TASK [Build TensorFlow for each Python version] ******************************** Monday 27 February 2023 18:10:38 +0000 (0:00:00.036) 0:00:33.983 ******* skipping: [localhost] => (item=3.8) skipping: [localhost] => (item=3.9) skipping: [localhost] => (item=3.10) skipping: [localhost] => (item=3.11) TASK [Build TensorFlow for each Python version (dual abi)] ********************* Monday 27 February 2023 18:10:38 +0000 (0:00:00.056) 0:00:34.040 ******* TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Monday 27 February 2023 18:10:39 +0000 (0:00:00.654) 0:00:34.694 ******* changed: [localhost] TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] *** Monday 27 February 2023 18:10:40 +0000 (0:00:00.627) 0:00:35.322 ******* skipping: [localhost] TASK [Fetch TensorFlow] ******************************************************** Monday 27 February 2023 18:10:40 +0000 (0:00:00.037) 0:00:35.359 ******* skipping: [localhost] TASK [(Python 3.8) patch TensorFlow tree] ************************************** Monday 27 February 2023 18:10:40 +0000 (0:00:00.038) 0:00:35.398 ******* TASK [tensorflow : Create linklibs shell script] ******************************* Monday 27 February 2023 18:10:40 +0000 (0:00:00.151) 0:00:35.550 ******* changed: [localhost] TASK [tensorflow : Create readme file about unit tests] ************************ Monday 27 February 2023 18:10:41 +0000 (0:00:00.693) 0:00:36.243 ******* changed: [localhost] TASK [tensorflow : Add to the copied files] ************************************ Monday 27 February 2023 18:10:41 +0000 (0:00:00.704) 0:00:36.947 ******* changed: [localhost] TASK [tensorflow : Add to the long_description in setup.py] ******************** Monday 27 February 2023 18:10:42 +0000 (0:00:00.561) 0:00:37.509 ******* changed: [localhost] TASK [tensorflow : Use nightly package requirements] *************************** Monday 27 February 2023 18:10:42 +0000 (0:00:00.552) 0:00:38.061 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) copy upper constraints] *********** Monday 27 February 2023 18:10:43 +0000 (0:00:00.392) 0:00:38.454 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) copy upper-constraints to within Docker context] *** Monday 27 February 2023 18:10:44 +0000 (0:00:00.769) 0:00:39.223 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) build Python versioned container] *** Monday 27 February 2023 18:10:44 +0000 (0:00:00.367) 0:00:39.591 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) start build container] ************ Monday 27 February 2023 18:11:27 +0000 (0:00:43.096) 0:01:22.687 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir] *** Monday 27 February 2023 18:11:29 +0000 (0:00:01.948) 0:01:24.636 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for bazel cache] ****** Monday 27 February 2023 18:11:30 +0000 (0:00:01.194) 0:01:25.830 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for bazelisk cache] *** Monday 27 February 2023 18:11:31 +0000 (0:00:00.828) 0:01:26.659 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for pip cache] ******** Monday 27 February 2023 18:11:32 +0000 (0:00:00.832) 0:01:27.492 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) build TensorFlow git] ************* Monday 27 February 2023 18:11:33 +0000 (0:00:00.884) 0:01:28.376 ******* fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- Extracting Bazel installation... Starting local Bazel server and connecting to it... INFO: Invocation ID: 67033efc-3ee3-4d84-ad37-0241d975ccb5 INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Reading rc options for 'build' from /usertools/aarch64.bazelrc: 'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/local/bin/python3 --python_path=/usr/local/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --distinct_host_configuration=false --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3 INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64.bazelrc: --disk_cache=/tf/cache INFO: Found applicable config definition build:ambe in file /usertools/aarch64.bazelrc: --distinct_host_configuration=false --flaky_test_attempts=3 --action_env=PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin --host_crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --extra_toolchains=@ml2014_aarch64_config_aarch64//crosstool:toolchain-linux-aarch64 --extra_execution_platforms=@ml2014_aarch64_config_aarch64_platform//:platform --host_platform=@ml2014_aarch64_config_aarch64_platform//:platform --platforms=@ml2014_aarch64_config_aarch64_platform//:platform --repo_env=TF_PYTHON_CONFIG_REPO=@ml2014_aarch64_config_python INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded currently loading: tensorflow/tools/pip_package Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured) Analyzing: target //tensorflow/tools/pip_package:build_pip_package (286 packages loaded, 4248 targets configured) Analyzing: target //tensorflow/tools/pip_package:build_pip_package (590 packages loaded, 32772 targets configured) INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (590 packages loaded, 33790 targets configured). INFO: Found 1 target... [0 / 101] [Prepa] Creating source manifest for //tensorflow/lite/tools:visualize ... (17 actions, 0 running) [7,348 / 17,715] Compiling tensorflow/tsl/platform/protobuf_util.cc; 6s local, remote-cache ... (111 actions, 110 running) [9,698 / 21,273] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 14s local, remote-cache ... (110 actions, 109 running) [11,721 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 23s local, remote-cache ... (111 actions, 110 running) [11,796 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 35s local, remote-cache ... (111 actions, 110 running) [12,263 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 48s local, remote-cache ... (111 actions, 110 running) [12,509 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 63s local, remote-cache ... (109 actions, 108 running) [12,757 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 80s local, remote-cache ... (111 actions, 110 running) [13,045 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 100s local, remote-cache ... (111 actions, 110 running) [13,200 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 123s local, remote-cache ... (109 actions, 108 running) [13,369 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 150s local, remote-cache ... (111 actions, 110 running) [13,613 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 180s local, remote-cache ... (111 actions, 110 running) [13,807 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 215s local, remote-cache ... (111 actions, 110 running) [14,086 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 255s local, remote-cache ... (111 actions, 110 running) [14,441 / 21,430] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 302s local, remote-cache ... (111 actions, 110 running) [14,792 / 21,430] Compiling tensorflow/core/util/batch_util.cc; 68s local, remote-cache ... (111 actions, 110 running) [15,172 / 21,430] Compiling tensorflow/core/kernels/rnn/lstm_ops.cc; 50s local, remote-cache ... (111 actions, 110 running) [15,584 / 21,430] Compiling tensorflow/core/kernels/padding_fifo_queue.cc; 82s local, remote-cache ... (111 actions, 110 running) [17,984 / 21,430] Compiling tensorflow/core/kernels/training_ops.cc; 112s local, remote-cache ... (111 actions, 110 running) [18,792 / 21,430] Compiling tensorflow/core/kernels/training_ops.cc; 205s local, remote-cache ... (111 actions, 110 running) [19,002 / 21,430] Compiling tensorflow/compiler/xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 167s local, remote-cache ... (111 actions, 110 running) [19,189 / 21,430] Compiling tensorflow/core/kernels/argmax_op.cc; 250s local, remote-cache ... (112 actions running) [19,633 / 21,430] Compiling tensorflow/core/kernels/matmul_op_real.cc; 387s local, remote-cache ... (112 actions running) ERROR: /tf/tensorflow/tensorflow/compiler/mlir/quantization/tensorflow/BUILD:272:11: Compiling tensorflow/compiler/mlir/quantization/tensorflow/passes/tf_quant_ops.cc failed: (Exit 1): gcc failed: error executing command /dt10/usr/bin/gcc -MD -MF bazel-out/aarch64-opt/bin/tensorflow/compiler/mlir/quantization/tensorflow/_objs/tf_quant_ops/tf_quant_ops.pic.d ... (remaining 213 arguments skipped) In file included from ./tensorflow/compiler/mlir/quantization/tensorflow/passes/tf_quant_ops.h:36, from tensorflow/compiler/mlir/quantization/tensorflow/passes/tf_quant_ops.cc:15: ./tensorflow/compiler/mlir/tensorflow/ir/tf_traits.h: In static member function 'static mlir::LogicalResult mlir::OpTrait::TF::SameOperandsAndResultTypeResolveRef<ConcreteType>::inferReturnTypeComponentsFromOperands(mlir::MLIRContext*, std::optional<mlir::Location>, mlir::ValueShapeRange, mlir::DictionaryAttr, mlir::RegionRange, llvm::SmallVectorImpl<mlir::ShapedTypeComponents>&)': ./tensorflow/compiler/mlir/tensorflow/ir/tf_traits.h:167:55: error: expected primary-expression before '>' token 167 | auto shape_type = ty.dyn_cast_or_null<ShapedType>(); | ^ ./tensorflow/compiler/mlir/tensorflow/ir/tf_traits.h:167:57: error: expected primary-expression before ')' token 167 | auto shape_type = ty.dyn_cast_or_null<ShapedType>(); | ^ Target //tensorflow/tools/pip_package:build_pip_package failed to build Use --verbose_failures to see the command lines of failed build steps. INFO: Elapsed time: 1101.906s, Critical Path: 394.52s INFO: 19709 processes: 11497 disk cache hit, 5109 internal, 3103 local. FAILED: Build did NOT complete successfully FAILED: Build did NOT complete successfully stderr_lines: <omitted> stdout: '' stdout_lines: <omitted> PLAY RECAP ********************************************************************* localhost : ok=28 changed=21 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0 Monday 27 February 2023 18:29:56 +0000 (0:18:22.935) 0:19:51.312 ******* =============================================================================== tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 1102.94s tensorflow_in_container : (Python 3.8) build Python versioned container -- 43.10s tensorflow : Fetch TensorFlow from git --------------------------------- 22.77s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.86s tensorflow_in_container : (Python 3.8) start build container ------------ 1.95s Gathering Facts --------------------------------------------------------- 1.67s Create cache dirs ------------------------------------------------------- 1.38s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.19s tensorflow : Save git commit hash to file ------------------------------- 1.11s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.88s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.83s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.83s tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.77s tensorflow : Create readme file about unit tests ------------------------ 0.70s tensorflow : Create linklibs shell script ------------------------------- 0.69s Build TensorFlow for each Python version (dual abi) --------------------- 0.65s tensorflow_in_container : Reset checkout to clean state ----------------- 0.63s tensorflow : Get oneline version of git log for this checkout ----------- 0.61s tensorflow : Add to the copied files ------------------------------------ 0.56s Build step 'Execute shell' marked build as failure

1 year, 2 months

1
1
0 0

Build failed in Jenkins: Tensorflow oneDNN Python package (manylinux2014 nightly) #349

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/3…> Changes: ------------------------------------------ [...truncated 16.71 KB...] TASK [tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build] *** Friday 24 February 2023 01:56:10 +0000 (0:00:00.044) 0:00:05.786 ******* changed: [localhost] TASK [tensorflow : Fetch TensorFlow] ******************************************* Friday 24 February 2023 01:56:13 +0000 (0:00:03.453) 0:00:09.239 ******* included: <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/w…> for localhost TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL git source] ********************* Friday 24 February 2023 01:56:13 +0000 (0:00:00.115) 0:00:09.354 ******* skipping: [localhost] TASK [tensorflow : Unpack TensorFlow-oneDNN-ACL git source] ******************** Friday 24 February 2023 01:56:13 +0000 (0:00:00.040) 0:00:09.395 ******* skipping: [localhost] TASK [tensorflow : Rename source dir for oneDNN build] ************************* Friday 24 February 2023 01:56:13 +0000 (0:00:00.037) 0:00:09.432 ******* skipping: [localhost] TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL from git] *********************** Friday 24 February 2023 01:56:13 +0000 (0:00:00.038) 0:00:09.471 ******* changed: [localhost] TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL from git at commit] ************* Friday 24 February 2023 01:56:35 +0000 (0:00:21.968) 0:00:31.440 ******* skipping: [localhost] TASK [tensorflow : Set world write access to source] *************************** Friday 24 February 2023 01:56:35 +0000 (0:00:00.036) 0:00:31.477 ******* changed: [localhost] TASK [tensorflow : Get oneline version of git log for this checkout] *********** Friday 24 February 2023 01:56:36 +0000 (0:00:00.374) 0:00:31.852 ******* changed: [localhost] TASK [tensorflow : Show git log] *********************************************** Friday 24 February 2023 01:56:36 +0000 (0:00:00.585) 0:00:32.438 ******* ok: [localhost] => git_log.stdout: 3f43b4eb7c183b3ce077dbee5b06c1b1ac201d72 Support quantizing models that use asset files to initialize resources. TASK [tensorflow : Record git commit hash to variable] ************************* Friday 24 February 2023 01:56:36 +0000 (0:00:00.044) 0:00:32.482 ******* ok: [localhost] TASK [tensorflow : Save git commit hash to file] ******************************* Friday 24 February 2023 01:56:36 +0000 (0:00:00.062) 0:00:32.544 ******* changed: [localhost] TASK [Build Bazel] ************************************************************* Friday 24 February 2023 01:56:38 +0000 (0:00:01.146) 0:00:33.691 ******* skipping: [localhost] TASK [Build TensorFlow for each Python version] ******************************** Friday 24 February 2023 01:56:38 +0000 (0:00:00.059) 0:00:33.751 ******* skipping: [localhost] => (item=3.8) skipping: [localhost] => (item=3.9) skipping: [localhost] => (item=3.10) skipping: [localhost] => (item=3.11) TASK [Build TensorFlow for each Python version (dual abi)] ********************* Friday 24 February 2023 01:56:38 +0000 (0:00:00.055) 0:00:33.807 ******* TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Friday 24 February 2023 01:56:38 +0000 (0:00:00.632) 0:00:34.439 ******* changed: [localhost] TASK [tensorflow_in_container : Remove TensorFlow-oneDNN-ACL git sources from previous build] *** Friday 24 February 2023 01:56:39 +0000 (0:00:00.828) 0:00:35.268 ******* skipping: [localhost] TASK [Fetch TensorFlow] ******************************************************** Friday 24 February 2023 01:56:39 +0000 (0:00:00.037) 0:00:35.306 ******* skipping: [localhost] TASK [(Python 3.8) patch TensorFlow tree] ************************************** Friday 24 February 2023 01:56:39 +0000 (0:00:00.037) 0:00:35.344 ******* TASK [tensorflow : Create linklibs shell script] ******************************* Friday 24 February 2023 01:56:39 +0000 (0:00:00.172) 0:00:35.516 ******* changed: [localhost] TASK [tensorflow : Create readme file about unit tests] ************************ Friday 24 February 2023 01:56:40 +0000 (0:00:00.692) 0:00:36.209 ******* changed: [localhost] TASK [tensorflow : Add to the copied files] ************************************ Friday 24 February 2023 01:56:41 +0000 (0:00:00.700) 0:00:36.909 ******* changed: [localhost] TASK [tensorflow : Add to the long_description in setup.py] ******************** Friday 24 February 2023 01:56:41 +0000 (0:00:00.596) 0:00:37.506 ******* changed: [localhost] TASK [tensorflow : Use nightly package requirements] *************************** Friday 24 February 2023 01:56:42 +0000 (0:00:00.581) 0:00:38.088 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) start build container] ************ Friday 24 February 2023 01:56:42 +0000 (0:00:00.392) 0:00:38.480 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir] *** Friday 24 February 2023 01:57:18 +0000 (0:00:35.153) 0:01:13.634 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for bazel cache] ****** Friday 24 February 2023 01:57:19 +0000 (0:00:01.227) 0:01:14.862 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for bazelisk cache] *** Friday 24 February 2023 01:57:20 +0000 (0:00:00.814) 0:01:15.677 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for pip cache] ******** Friday 24 February 2023 01:57:20 +0000 (0:00:00.822) 0:01:16.499 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) copy upper constraints] *********** Friday 24 February 2023 01:57:21 +0000 (0:00:00.788) 0:01:17.288 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) install Python packages] ********** Friday 24 February 2023 01:57:22 +0000 (0:00:00.718) 0:01:18.006 ******* changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git] *** Friday 24 February 2023 01:57:54 +0000 (0:00:31.677) 0:01:49.683 ******* fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- Extracting Bazel installation... Starting local Bazel server and connecting to it... INFO: Invocation ID: 8c55d19e-948a-4502-964f-50a104c0c7bf INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Reading rc options for 'build' from /usertools/aarch64.bazelrc: 'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/bin/python3 --action_env PYTHON_LIB_PATH=/usr/lib/tf_python --python_path=/usr/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --distinct_host_configuration=false --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3 INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64.bazelrc: --disk_cache=/tf/cache INFO: Found applicable config definition build:ambe in file /usertools/aarch64.bazelrc: --distinct_host_configuration=false --flaky_test_attempts=3 --action_env=PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin --host_crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --extra_toolchains=@ml2014_aarch64_config_aarch64//crosstool:toolchain-linux-aarch64 --extra_execution_platforms=@ml2014_aarch64_config_aarch64_platform//:platform --host_platform=@ml2014_aarch64_config_aarch64_platform//:platform --platforms=@ml2014_aarch64_config_aarch64_platform//:platform --repo_env=TF_PYTHON_CONFIG_REPO=@ml2014_aarch64_config_python INFO: Found applicable config definition build:mkl_aarch64_threadpool in file /tf/tensorflow/.bazelrc: --define=build_with_mkl_aarch64=true -c opt INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/tensorflow/… failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-p… failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured) WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/openxla/sta… failed: class java.io.FileNotFoundException GET returned 404 Not Found Analyzing: target //tensorflow/tools/pip_package:build_pip_package (289 packages loaded, 4306 targets configured) INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (593 packages loaded, 37030 targets configured). INFO: Found 1 target... [0 / 183] [Prepa] Creating source manifest for //tensorflow/lite/python:tflite_convert ... (5 actions, 0 running) [12,136 / 23,108] Compiling tensorflow/lite/delegates/xnnpack/quantization_util.cc; 11s local, remote-cache ... (111 actions, 110 running) [12,210 / 23,108] Compiling tensorflow/compiler/xla/literal_comparison.cc; 21s local, remote-cache ... (111 actions, 110 running) [12,294 / 23,108] Compiling tensorflow/compiler/xla/literal.cc; 36s local, remote-cache ... (111 actions, 110 running) [12,387 / 23,108] Compiling tensorflow/compiler/xla/literal.cc; 52s local, remote-cache ... (112 actions running) [12,622 / 23,108] Compiling tensorflow/compiler/xla/hlo/ir/hlo_instruction.cc; 38s local, remote-cache ... (112 actions running) [12,873 / 23,108] Compiling tensorflow/compiler/xla/service/memory_space_assignment.cc; 51s local, remote-cache ... (112 actions running) [13,013 / 23,108] Compiling tensorflow/compiler/xla/service/algebraic_simplifier.cc; 63s local, remote-cache ... (112 actions running) [13,169 / 23,108] Compiling tensorflow/python/client/tf_session_wrapper.cc; 55s local, remote-cache ... (112 actions running) [13,383 / 23,108] Compiling tensorflow/core/kernels/rnn/lstm_ops.cc; 66s local, remote-cache ... (112 actions running) [13,695 / 23,108] Compiling tensorflow/core/kernels/padding_fifo_queue.cc; 52s local, remote-cache ... (112 actions running) [13,919 / 23,108] Compiling tensorflow/core/kernels/lrn_op.cc; 66s local, remote-cache ... (112 actions running) [14,212 / 23,108] Compiling tensorflow/core/kernels/image/mirror_pad_op_cpu_impl_5.cc; 53s local, remote-cache ... (112 actions running) [14,634 / 23,108] Compiling tensorflow/core/kernels/training_ops.cc; 64s local, remote-cache ... (112 actions running) [17,905 / 24,452] Compiling tensorflow/core/kernels/training_ops.cc; 131s local, remote-cache ... (112 actions running) [18,516 / 24,452] Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 42s local, remote-cache ... (112 actions running) [18,910 / 24,452] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops.cc; 66s local, remote-cache ... (112 actions running) [19,369 / 24,452] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops.cc; 168s local, remote-cache ... (111 actions, 110 running) [19,627 / 24,452] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops.cc; 285s local, remote-cache ... (112 actions running) [19,805 / 24,452] Compiling tensorflow/core/kernels/cwise_op_select.cc; 181s local, remote-cache ... (112 actions running) [20,435 / 24,452] Compiling tensorflow/core/kernels/matmul_op_real.cc; 240s local, remote-cache ... (112 actions running) [21,299 / 24,452] Compiling tensorflow/core/kernels/matmul_op_real.cc; 418s local, remote-cache ... (112 actions running) [22,060 / 24,452] Compiling tensorflow/compiler/xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 135s local, remote-cache ... (112 actions running) [22,817 / 24,452] Compiling tensorflow/dtensor/mlir/expansions/iterator_spmd_expander.cc; 40s local, remote-cache ... (112 actions running) [24,042 / 24,484] Compiling tensorflow/dtensor/cc/dtensor_device.cc; 60s local, remote-cache ... (111 actions, 110 running) [24,592 / 24,659] Linking tensorflow/libtensorflow_cc.so.2.13.0; 161s local, remote-cache ERROR: /tf/tensorflow/tensorflow/BUILD:1635:19: Executing genrule //tensorflow:tf_python_api_gen_v2 failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped) Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/tools/api/generator/create_python_api.py", line 22, in <module> from tensorflow.python.tools.api.generator import doc_srcs File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/__init__.py", line 37, in <module> from tensorflow.python.eager import context File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/eager/context.py", line 28, in <module> from tensorflow.core.framework import function_pb2 File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/core/framework/function_pb2.py", line 5, in <module> from google.protobuf.internal import builder as _builder ModuleNotFoundError: No module named 'google.protobuf' Target //tensorflow/tools/pip_package:build_pip_package failed to build Use --verbose_failures to see the command lines of failed build steps. ERROR: /tf/tensorflow/tensorflow/python/tools/BUILD:282:10 Middleman _middlemen/tensorflow_Spython_Stools_Sprint_Uselective_Uregistration_Uheader-runfiles failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped) INFO: Elapsed time: 2802.608s, Critical Path: 1106.80s INFO: 24658 processes: 11508 disk cache hit, 5600 internal, 7550 local. FAILED: Build did NOT complete successfully FAILED: Build did NOT complete successfully stderr_lines: <omitted> stdout: '' stdout_lines: <omitted> PLAY RECAP ********************************************************************* localhost : ok=27 changed=20 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0 Friday 24 February 2023 02:44:37 +0000 (0:46:43.868) 0:48:33.552 ******* =============================================================================== tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git 2803.87s tensorflow_in_container : (Python 3.8) start build container ----------- 35.15s tensorflow_in_container : (Python 3.8) install Python packages --------- 31.68s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 21.97s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.45s Gathering Facts --------------------------------------------------------- 2.63s Create cache dirs ------------------------------------------------------- 1.40s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.23s tensorflow : Save git commit hash to file ------------------------------- 1.15s tensorflow_in_container : Reset checkout to clean state ----------------- 0.83s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.82s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.81s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.79s tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.72s tensorflow : Create readme file about unit tests ------------------------ 0.70s tensorflow : Create linklibs shell script ------------------------------- 0.69s Build TensorFlow for each Python version (dual abi) --------------------- 0.63s tensorflow : Add to the copied files ------------------------------------ 0.60s tensorflow : Get oneline version of git log for this checkout ----------- 0.59s Build step 'Execute shell' marked build as failure

1 year, 2 months

1
2
0 0

Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #703

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/703/disp…> Changes: ------------------------------------------ [...truncated 1002.74 KB...] Stats over 20 runs: max = 5.5s, min = 2.7s, avg = 3.4s, dev = 0.7s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 6.5s Stats over 20 runs: max = 6.5s, min = 3.0s, avg = 4.7s, dev = 1.0s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 11.3s Stats over 20 runs: max = 11.3s, min = 3.1s, avg = 5.5s, dev = 1.7s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 11.3s Stats over 20 runs: max = 11.3s, min = 3.6s, avg = 5.2s, dev = 1.7s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 6.2s Stats over 20 runs: max = 6.2s, min = 5.4s, avg = 5.7s, dev = 0.2s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 12.1s Stats over 20 runs: max = 12.1s, min = 9.0s, avg = 10.6s, dev = 0.8s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 9.4s Stats over 20 runs: max = 9.4s, min = 8.2s, avg = 8.8s, dev = 0.4s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 42.5s Stats over 20 runs: max = 42.5s, min = 6.8s, avg = 15.3s, dev = 11.0s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 15.4s Stats over 20 runs: max = 15.4s, min = 9.5s, avg = 11.4s, dev = 1.8s //tensorflow/python/kernel_tests:metrics_test PASSED in 33.0s Stats over 20 runs: max = 33.0s, min = 4.8s, avg = 15.2s, dev = 8.2s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 5.4s Stats over 20 runs: max = 5.4s, min = 2.5s, avg = 3.2s, dev = 0.7s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 12.0s Stats over 20 runs: max = 12.0s, min = 2.4s, avg = 4.6s, dev = 2.5s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 40.7s Stats over 20 runs: max = 40.7s, min = 2.8s, avg = 12.3s, dev = 12.3s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 94.0s Stats over 20 runs: max = 94.0s, min = 23.5s, avg = 48.9s, dev = 18.6s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 5.7s Stats over 20 runs: max = 5.7s, min = 3.0s, avg = 4.3s, dev = 1.0s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 13.5s Stats over 20 runs: max = 13.5s, min = 6.3s, avg = 9.5s, dev = 2.0s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 150.4s Stats over 20 runs: max = 150.4s, min = 32.6s, avg = 82.4s, dev = 35.8s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 17.8s Stats over 20 runs: max = 17.8s, min = 3.0s, avg = 8.0s, dev = 5.0s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 16.9s Stats over 20 runs: max = 16.9s, min = 4.1s, avg = 9.9s, dev = 4.5s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 16.4s Stats over 20 runs: max = 16.4s, min = 13.6s, avg = 15.2s, dev = 0.8s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 60.0s Stats over 20 runs: max = 60.0s, min = 4.0s, avg = 24.9s, dev = 19.5s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 18.1s Stats over 20 runs: max = 18.1s, min = 2.7s, avg = 5.5s, dev = 3.4s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 18.6s Stats over 24 runs: max = 18.6s, min = 6.7s, avg = 12.2s, dev = 3.0s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 19.8s Stats over 24 runs: max = 19.8s, min = 6.3s, avg = 12.1s, dev = 3.6s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 20.2s Stats over 24 runs: max = 20.2s, min = 6.5s, avg = 10.8s, dev = 4.1s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 6.8s Stats over 25 runs: max = 6.8s, min = 5.7s, avg = 6.0s, dev = 0.2s //tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 33.6s Stats over 25 runs: max = 33.6s, min = 6.8s, avg = 11.0s, dev = 6.7s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 7.5s Stats over 30 runs: max = 7.5s, min = 6.5s, avg = 7.0s, dev = 0.3s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 12.2s Stats over 30 runs: max = 12.2s, min = 10.5s, avg = 11.2s, dev = 0.4s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 6.8s Stats over 30 runs: max = 6.8s, min = 5.6s, avg = 6.1s, dev = 0.3s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 6.6s Stats over 30 runs: max = 6.6s, min = 5.7s, avg = 6.1s, dev = 0.2s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 15.7s Stats over 30 runs: max = 15.7s, min = 2.8s, avg = 6.3s, dev = 3.0s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 7.0s Stats over 31 runs: max = 7.0s, min = 5.9s, avg = 6.4s, dev = 0.2s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 9.1s Stats over 32 runs: max = 9.1s, min = 5.9s, avg = 6.6s, dev = 0.7s //tensorflow/python/data/experimental/kernel_tests/service:auto_shard_test PASSED in 14.4s Stats over 32 runs: max = 14.4s, min = 3.1s, avg = 9.0s, dev = 2.9s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 26.3s Stats over 32 runs: max = 26.3s, min = 6.7s, avg = 15.1s, dev = 4.5s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 8.5s Stats over 40 runs: max = 8.5s, min = 6.1s, avg = 7.3s, dev = 0.9s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 7.6s Stats over 40 runs: max = 7.6s, min = 5.8s, avg = 6.5s, dev = 0.4s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 8.4s Stats over 40 runs: max = 8.4s, min = 6.6s, avg = 7.5s, dev = 0.4s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 9.0s Stats over 40 runs: max = 9.0s, min = 6.2s, avg = 7.1s, dev = 0.6s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 83.5s Stats over 50 runs: max = 83.5s, min = 16.2s, avg = 36.8s, dev = 24.1s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 35.8s Stats over 50 runs: max = 35.8s, min = 2.4s, avg = 9.7s, dev = 7.4s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 38.2s Stats over 50 runs: max = 38.2s, min = 2.5s, avg = 9.3s, dev = 7.7s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 9.2s Stats over 50 runs: max = 9.2s, min = 6.2s, avg = 6.9s, dev = 0.6s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 9.8s Stats over 50 runs: max = 9.8s, min = 8.1s, avg = 8.9s, dev = 0.4s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 13.2s Stats over 50 runs: max = 13.2s, min = 7.9s, avg = 9.8s, dev = 1.1s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 21.5s Stats over 50 runs: max = 21.5s, min = 5.4s, avg = 10.6s, dev = 3.7s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 5.6s Stats over 50 runs: max = 5.6s, min = 2.5s, avg = 3.4s, dev = 0.8s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 5.5s Stats over 50 runs: max = 5.5s, min = 2.6s, avg = 3.1s, dev = 0.6s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 29.1s Stats over 50 runs: max = 29.1s, min = 6.4s, avg = 14.4s, dev = 5.6s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 11.2s Stats over 50 runs: max = 11.2s, min = 2.8s, avg = 3.9s, dev = 1.2s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 10.1s Stats over 50 runs: max = 10.1s, min = 2.5s, avg = 3.9s, dev = 2.0s Executed 3602 out of 3602 tests: 3599 tests pass and 3 fail locally. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages] *** Saturday 25 February 2023 11:15:05 +0000 (1:08:03.515) 2:01:48.106 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) save list of installed Python packages] *** Saturday 25 February 2023 11:15:07 +0000 (0:00:01.965) 2:01:50.072 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) save tests output to file] ******** Saturday 25 February 2023 11:15:08 +0000 (0:00:00.695) 2:01:50.767 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) save tests stderr output to file] *** Saturday 25 February 2023 11:15:08 +0000 (0:00:00.708) 2:01:51.475 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) Extract number of tests run] ****** Saturday 25 February 2023 11:15:09 +0000 (0:00:00.698) 2:01:52.174 ***** ok: [localhost] TASK [tensorflow_in_container : (Python 3.8) Show number of tests run] ********* Saturday 25 February 2023 11:15:09 +0000 (0:00:00.102) 2:01:52.276 ***** ok: [localhost] => ut_tests_line: '' TASK [tensorflow_in_container : (Python 3.8) Extract failed tests] ************* Saturday 25 February 2023 11:15:09 +0000 (0:00:00.046) 2:01:52.323 ***** ok: [localhost] TASK [tensorflow_in_container : (Python 3.8) Show which tests failed] ********** Saturday 25 February 2023 11:15:09 +0000 (0:00:00.104) 2:01:52.427 ***** ok: [localhost] => tests_failed: 'FAILED: ' TASK [tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one] *** Saturday 25 February 2023 11:15:09 +0000 (0:00:00.048) 2:01:52.476 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) Get list of wheel files] ********** Saturday 25 February 2023 11:22:45 +0000 (0:07:35.971) 2:09:28.447 ***** ok: [localhost] TASK [tensorflow_in_container : (Python 3.8) Get filename of latest wheel] ***** Saturday 25 February 2023 11:22:46 +0000 (0:00:00.602) 2:09:29.050 ***** ok: [localhost] TASK [tensorflow_in_container : (Python 3.8) move manylinux2014 wheel outside] *** Saturday 25 February 2023 11:22:46 +0000 (0:00:00.067) 2:09:29.118 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) Remove manylinux2014 wheel] ******* Saturday 25 February 2023 11:22:48 +0000 (0:00:02.368) 2:09:31.486 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) stop build container] ************* Saturday 25 February 2023 11:22:49 +0000 (0:00:00.422) 2:09:31.908 ***** changed: [localhost] TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Saturday 25 February 2023 11:26:25 +0000 (0:03:35.878) 2:13:07.787 ***** changed: [localhost] TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] *** Saturday 25 February 2023 11:26:25 +0000 (0:00:00.639) 2:13:08.426 ***** skipping: [localhost] TASK [Fetch TensorFlow] ******************************************************** Saturday 25 February 2023 11:26:25 +0000 (0:00:00.039) 2:13:08.466 ***** skipping: [localhost] TASK [(Python 3.9) patch TensorFlow tree] ************************************** Saturday 25 February 2023 11:26:25 +0000 (0:00:00.039) 2:13:08.506 ***** TASK [tensorflow : Create linklibs shell script] ******************************* Saturday 25 February 2023 11:26:26 +0000 (0:00:00.176) 2:13:08.682 ***** changed: [localhost] TASK [tensorflow : Create readme file about unit tests] ************************ Saturday 25 February 2023 11:26:26 +0000 (0:00:00.699) 2:13:09.381 ***** changed: [localhost] TASK [tensorflow : Add to the copied files] ************************************ Saturday 25 February 2023 11:26:27 +0000 (0:00:00.703) 2:13:10.085 ***** changed: [localhost] TASK [tensorflow : Add to the long_description in setup.py] ******************** Saturday 25 February 2023 11:26:27 +0000 (0:00:00.370) 2:13:10.455 ***** changed: [localhost] TASK [tensorflow : Use nightly package requirements] *************************** Saturday 25 February 2023 11:26:28 +0000 (0:00:00.364) 2:13:10.820 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.9) copy upper constraints] *********** Saturday 25 February 2023 11:26:28 +0000 (0:00:00.395) 2:13:11.215 ***** ok: [localhost] TASK [tensorflow_in_container : (Python 3.9) copy upper-constraints to within Docker context] *** Saturday 25 February 2023 11:26:29 +0000 (0:00:00.764) 2:13:11.979 ***** fatal: [localhost]: FAILED! => changed=true cmd: - cp - <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/wheel…> - <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/confi…> delta: '0:00:00.003706' end: '2023-02-25 11:26:29.715211' msg: non-zero return code rc: 1 start: '2023-02-25 11:26:29.711505' stderr: 'cp: cannot create regular file ''<https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/confi…''>: Permission denied' stderr_lines: <omitted> stdout: '' stdout_lines: <omitted> PLAY RECAP ********************************************************************* localhost : ok=54 changed=40 unreachable=0 failed=1 skipped=10 rescued=0 ignored=1 Saturday 25 February 2023 11:26:29 +0000 (0:00:00.344) 2:13:12.324 ***** =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow git tests ------ 4083.52s tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 3038.86s tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one - 455.97s tensorflow_in_container : (Python 3.8) stop build container ----------- 215.88s tensorflow_in_container : (Python 3.8) build Python package ------------ 96.26s tensorflow_in_container : (Python 3.8) build Python versioned container -- 42.89s tensorflow : Fetch TensorFlow from git --------------------------------- 21.49s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.79s Gathering Facts --------------------------------------------------------- 2.62s tensorflow_in_container : (Python 3.8) move manylinux2014 wheel outside --- 2.37s tensorflow_in_container : (Python 3.8) collect list of installed Python packages --- 1.97s tensorflow_in_container : (Python 3.8) start build container ------------ 1.93s tensorflow : Create readme file about unit tests ------------------------ 1.41s Create cache dirs ------------------------------------------------------- 1.40s tensorflow : Create linklibs shell script ------------------------------- 1.39s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.26s tensorflow : Save git commit hash to file ------------------------------- 1.12s tensorflow : Add to the copied files ------------------------------------ 0.93s tensorflow : Add to the long_description in setup.py -------------------- 0.92s Build step 'Execute shell' marked build as failure

1 year, 2 months

1
1
0 0

Build failed in Jenkins: Tensorflow Python package (manylinux2014 nightly) #701

by ci_notify＠linaro.org

See <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/701/disp…> Changes: ------------------------------------------ [...truncated 6.55 KB...] skipping: [localhost] => (item={'key': '2.9', 'value': {'tensorflow_version': '2.9.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.9.0', 'tensorboard_version': '==2.9.0', 'tensorflow_estimator_version': '==2.9.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64,-requires-gpu', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.8', 'value': {'tensorflow_version': '2.8.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.8.0', 'tensorboard_version': '==2.8.0', 'tensorflow_estimator_version': '==2.8.0', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/compiler/mlir/lite/tests:prepare-tf.mlir.test', '//tensorflow/compiler/mlir/tensorflow:dump_graph_test', '//tensorflow/core/common_runtime:direct_session_test', '//tensorflow/core/common_runtime:direct_session_with_debug_test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:quantize_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python:quantized_ops_test', '//tensorflow/python:script_ops_test', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}}) skipping: [localhost] => (item={'key': '2.7', 'value': {'tensorflow_version': '2.7.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.5', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.7.0', 'tensorboard_version': '==2.7.0', 'tensorflow_estimator_version': '==2.7.0', 'python_install_packages': ['portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': ['//tensorflow/java/...', '//tensorflow/lite/...', '//tensorflow/compiler/xla/python/...', '//tensorflow/compiler/xla/service/cpu/...', '//tensorflow/compiler/xla/tests/...', '//tensorflow/core/ir/...', '//tensorflow/python/tools/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/kernels:quantized_bias_add_op_test', '//tensorflow/core/kernels:requantize_op_test', '//tensorflow/core/kernels:sparse_matmul_op_test', '//tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test', '//tensorflow/python/debug/cli:debugger_cli_common_test', '//tensorflow/python/debug/examples/v2:examples_v2_test', '//tensorflow/python/eager:function_test', '//tensorflow/python/keras/mixed_precision:model_test', '//tensorflow/python/keras/preprocessing:image_test', '//tensorflow/python/kernel_tests:init_ops_test', '//tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test', '//tensorflow/python/kernel_tests:self_adjoint_eig_op_test', '//tensorflow/python/kernel_tests:sparse_matmul_op_test', '//tensorflow/python/lib/io:file_io_test', '//tensorflow/python/ops/ragged:ragged_dispatch_test', '//tensorflow/python/ops/ragged:ragged_print_op_test', '//tensorflow/python/profiler/integration_test:profiler_api_test', '//tensorflow/python/profiler:profiler_v2_test', '//tensorflow/python/util:dispatch_test', '//tensorflow/python/util:traceback_utils_test', '//tensorflow/tools/api/tests:api_compatibility_test', '//tensorflow/tools/docs:tf_doctest', '//tensorflow/tools/graph_transforms:transforms_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.6', 'value': {'tensorflow_version': '2.6.5', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.37.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.6.0', 'tensorboard_version': '==2.6.0', 'tensorflow_estimator_version': '==2.6.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.5', 'value': {'tensorflow_version': '2.5.3', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.4.0', 'grpcio_version': '~=1.34.0', 'h5py_version': '~=3.1.0', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.5.0', 'tensorboard_version': '==2.5.0', 'tensorflow_estimator_version': '==2.5.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '2.4', 'value': {'tensorflow_version': '2.4.4', 'bazel_version': 'bazelisk', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.3.3', 'grpcio_version': '~=1.32.0', 'h5py_version': '~=2.10', 'numpy_version': '~=1.19.2', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==2.4.3', 'tensorboard_version': '==2.4.1', 'tensorflow_estimator_version': '==2.4.0', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m', 'cp38-cp38', 'cp39-cp39']}}) skipping: [localhost] => (item={'key': '1.15', 'value': {'tensorflow_version': '1.15.5', 'bazel_version': '0.29.1', 'flatbuffers_version': '~=1.12.0', 'gast_version': '==0.2.2', 'grpcio_version': '~=1.32.0', 'h5py_version': '==2.10', 'numpy_version': '~=1.18.0', 'absl_version': '~=0.10', 'scipy_version': '~=1.5.4', 'keras_version': '==1.2.2', 'tensorboard_version': '==1.15.0', 'tensorflow_estimator_version': '==1.15.2', 'python_install_packages': ['keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': False, 'run_serial_unit_tests': False, 'onednn_ut_exclude': '', 'unit_tests_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '', 'python_versions': ['cp36-cp36m', 'cp37-cp37m']}}) TASK [tensorflow : Set TensorFlow and other package versions] ****************** Thursday 23 February 2023 18:10:09 +0000 (0:00:00.279) 0:00:04.653 ***** ok: [localhost] TASK [tensorflow : Set build dir for TensorFlow git] *************************** Thursday 23 February 2023 18:10:09 +0000 (0:00:00.083) 0:00:04.737 ***** ok: [localhost] TASK [tensorflow : Remove TensorFlow git sources from previous build] ********** Thursday 23 February 2023 18:10:09 +0000 (0:00:00.045) 0:00:04.782 ***** changed: [localhost] TASK [tensorflow : Fetch TensorFlow] ******************************************* Thursday 23 February 2023 18:10:12 +0000 (0:00:03.655) 0:00:08.438 ***** included: <https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/confi…> for localhost TASK [tensorflow : Fetch TensorFlow git source] ******************************** Thursday 23 February 2023 18:10:13 +0000 (0:00:00.116) 0:00:08.554 ***** skipping: [localhost] TASK [tensorflow : Unpack TensorFlow git source] ******************************* Thursday 23 February 2023 18:10:13 +0000 (0:00:00.041) 0:00:08.595 ***** skipping: [localhost] TASK [tensorflow : Rename source dir for oneDNN build] ************************* Thursday 23 February 2023 18:10:13 +0000 (0:00:00.037) 0:00:08.633 ***** skipping: [localhost] TASK [tensorflow : Fetch TensorFlow from git] ********************************** Thursday 23 February 2023 18:10:13 +0000 (0:00:00.040) 0:00:08.673 ***** changed: [localhost] TASK [tensorflow : Fetch TensorFlow from git at commit] ************************ Thursday 23 February 2023 18:10:35 +0000 (0:00:22.485) 0:00:31.159 ***** skipping: [localhost] TASK [tensorflow : Set world write access to source] *************************** Thursday 23 February 2023 18:10:35 +0000 (0:00:00.037) 0:00:31.197 ***** changed: [localhost] TASK [tensorflow : Get oneline version of git log for this checkout] *********** Thursday 23 February 2023 18:10:36 +0000 (0:00:00.374) 0:00:31.571 ***** changed: [localhost] TASK [tensorflow : Show git log] *********************************************** Thursday 23 February 2023 18:10:36 +0000 (0:00:00.584) 0:00:32.156 ***** ok: [localhost] => git_log.stdout: 62dcf7e02c0dae336bfb54aa83a03ddd22ccc9af Set up step id in c_api_tfrt TASK [tensorflow : Record git commit hash to variable] ************************* Thursday 23 February 2023 18:10:36 +0000 (0:00:00.044) 0:00:32.200 ***** ok: [localhost] TASK [tensorflow : Save git commit hash to file] ******************************* Thursday 23 February 2023 18:10:36 +0000 (0:00:00.085) 0:00:32.286 ***** changed: [localhost] TASK [Build Bazel] ************************************************************* Thursday 23 February 2023 18:10:37 +0000 (0:00:01.115) 0:00:33.401 ***** skipping: [localhost] TASK [Build TensorFlow for each Python version] ******************************** Thursday 23 February 2023 18:10:37 +0000 (0:00:00.037) 0:00:33.439 ***** skipping: [localhost] => (item=3.8) skipping: [localhost] => (item=3.9) skipping: [localhost] => (item=3.10) skipping: [localhost] => (item=3.11) TASK [Build TensorFlow for each Python version (dual abi)] ********************* Thursday 23 February 2023 18:10:38 +0000 (0:00:00.055) 0:00:33.494 ***** TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Thursday 23 February 2023 18:10:38 +0000 (0:00:00.632) 0:00:34.126 ***** changed: [localhost] TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] *** Thursday 23 February 2023 18:10:39 +0000 (0:00:00.632) 0:00:34.759 ***** skipping: [localhost] TASK [Fetch TensorFlow] ******************************************************** Thursday 23 February 2023 18:10:39 +0000 (0:00:00.037) 0:00:34.796 ***** skipping: [localhost] TASK [(Python 3.8) patch TensorFlow tree] ************************************** Thursday 23 February 2023 18:10:39 +0000 (0:00:00.039) 0:00:34.835 ***** TASK [tensorflow : Create linklibs shell script] ******************************* Thursday 23 February 2023 18:10:39 +0000 (0:00:00.152) 0:00:34.988 ***** changed: [localhost] TASK [tensorflow : Create readme file about unit tests] ************************ Thursday 23 February 2023 18:10:40 +0000 (0:00:00.691) 0:00:35.679 ***** changed: [localhost] TASK [tensorflow : Add to the copied files] ************************************ Thursday 23 February 2023 18:10:40 +0000 (0:00:00.726) 0:00:36.406 ***** changed: [localhost] TASK [tensorflow : Add to the long_description in setup.py] ******************** Thursday 23 February 2023 18:10:41 +0000 (0:00:00.563) 0:00:36.970 ***** changed: [localhost] TASK [tensorflow : Use nightly package requirements] *************************** Thursday 23 February 2023 18:10:42 +0000 (0:00:00.552) 0:00:37.522 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) start build container] ************ Thursday 23 February 2023 18:10:42 +0000 (0:00:00.392) 0:00:37.914 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir] *** Thursday 23 February 2023 18:10:45 +0000 (0:00:03.400) 0:00:41.314 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for bazel cache] ****** Thursday 23 February 2023 18:10:47 +0000 (0:00:01.223) 0:00:42.538 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for bazelisk cache] *** Thursday 23 February 2023 18:10:47 +0000 (0:00:00.843) 0:00:43.381 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) create link for pip cache] ******** Thursday 23 February 2023 18:10:48 +0000 (0:00:00.828) 0:00:44.209 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) copy upper constraints] *********** Thursday 23 February 2023 18:10:49 +0000 (0:00:00.817) 0:00:45.026 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) install Python packages] ********** Thursday 23 February 2023 18:10:50 +0000 (0:00:00.717) 0:00:45.743 ***** changed: [localhost] TASK [tensorflow_in_container : (Python 3.8) build TensorFlow git] ************* Thursday 23 February 2023 18:11:20 +0000 (0:00:30.583) 0:01:16.327 ***** fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- Extracting Bazel installation... Starting local Bazel server and connecting to it... INFO: Invocation ID: 5273ec2c-5594-420a-b0c1-20ca14e4ddb5 INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc: 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Reading rc options for 'build' from /usertools/aarch64.bazelrc: 'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/bin/python3 --action_env PYTHON_LIB_PATH=/usr/lib/tf_python --python_path=/usr/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --distinct_host_configuration=false --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3 INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64.bazelrc: --disk_cache=/tf/cache INFO: Found applicable config definition build:ambe in file /usertools/aarch64.bazelrc: --distinct_host_configuration=false --flaky_test_attempts=3 --action_env=PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin --host_crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --crosstool_top=@ml2014_aarch64_config_aarch64//crosstool:toolchain --extra_toolchains=@ml2014_aarch64_config_aarch64//crosstool:toolchain-linux-aarch64 --extra_execution_platforms=@ml2014_aarch64_config_aarch64_platform//:platform --host_platform=@ml2014_aarch64_config_aarch64_platform//:platform --platforms=@ml2014_aarch64_config_aarch64_platform//:platform --repo_env=TF_PYTHON_CONFIG_REPO=@ml2014_aarch64_config_python INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured) Analyzing: target //tensorflow/tools/pip_package:build_pip_package (287 packages loaded, 4244 targets configured) INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (590 packages loaded, 33778 targets configured). INFO: Found 1 target... [0 / 119] [Prepa] Expanding template tensorflow/lite/python/tflite_convert ... (5 actions, 0 running) [12,976 / 16,049] Compiling tensorflow/lite/kernels/register_ref.cc; 1s local, remote-cache ... (63 actions, 30 running) [12,987 / 16,049] Compiling tensorflow/compiler/xla/translate/hlo_to_mhlo/hlo_utils.cc; 11s local, remote-cache ... (112 actions running) [13,048 / 16,049] Compiling tensorflow/compiler/xla/translate/hlo_to_mhlo/hlo_utils.cc; 22s local, remote-cache ... (112 actions running) [13,554 / 16,049] Compiling tensorflow/compiler/xla/translate/hlo_to_mhlo/hlo_function_importer.cc; 35s local, remote-cache ... (112 actions running) [13,600 / 16,049] Compiling tensorflow/compiler/xla/service/cpu/ir_emitter.cc; 49s local, remote-cache ... (112 actions running) [13,635 / 16,049] Compiling tensorflow/compiler/xla/service/cpu/cpu_compiler.cc; 66s local, remote-cache ... (112 actions running) [13,685 / 16,049] Compiling tensorflow/compiler/xla/service/cpu/cpu_compiler.cc; 85s local, remote-cache ... (112 actions running) [13,741 / 16,049] Compiling tensorflow/core/kernels/scatter_nd_op.cc; 60s local, remote-cache ... (112 actions running) [13,784 / 16,049] Compiling tensorflow/core/kernels/scatter_nd_op.cc; 85s local, remote-cache ... (112 actions running) [13,856 / 16,049] Compiling tensorflow/core/kernels/scatter_nd_op.cc; 114s local, remote-cache ... (112 actions running) [13,957 / 16,049] Compiling tensorflow/core/kernels/pad_op.cc; 139s local, remote-cache ... (112 actions running) [14,010 / 16,049] Compiling tensorflow/core/kernels/pad_op.cc; 177s local, remote-cache ... (112 actions running) [14,079 / 16,049] Compiling tensorflow/core/kernels/linalg/svd_op_complex64.cc; 152s local, remote-cache ... (112 actions running) [14,221 / 16,049] Compiling tensorflow/core/kernels/linalg/matrix_square_root_op.cc; 194s local, remote-cache ... (112 actions running) [14,521 / 16,049] Compiling tensorflow/core/kernels/linalg/matrix_square_root_op.cc; 253s local, remote-cache ... (112 actions running) [14,684 / 16,049] Compiling tensorflow/core/kernels/linalg/matrix_square_root_op.cc; 321s local, remote-cache ... (112 actions running) [14,829 / 16,049] Compiling tensorflow/core/kernels/matmul_op_real.cc; 365s local, remote-cache ... (110 actions, 108 running) [14,975 / 16,049] Compiling tensorflow/core/kernels/matmul_op_real.cc; 454s local, remote-cache ... (112 actions running) [15,169 / 16,049] Compiling tensorflow/compiler/mlir/lite/transforms/legalize_tf.cc; 107s local, remote-cache ... (112 actions running) [19,303 / 19,822] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops.cc; 222s local, remote-cache ... (112 actions running) [23,441 / 23,561] Compiling tensorflow/core/kernels/conv_ops.cc; 217s local, remote-cache ... (56 actions running) [23,492 / 23,561] Compiling tensorflow/core/kernels/conv_ops.cc; 373s local, remote-cache [23,494 / 23,561] Linking tensorflow/libtensorflow_cc.so.2.13.0; 58s local, remote-cache [23,494 / 23,561] Linking tensorflow/libtensorflow_cc.so.2.13.0; 264s local, remote-cache [23,494 / 23,561] Linking tensorflow/libtensorflow_cc.so.2.13.0; 501s local, remote-cache ERROR: /tf/tensorflow/tensorflow/BUILD:1635:19: Executing genrule //tensorflow:tf_python_api_gen_v2 failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped) Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/tools/api/generator/create_python_api.py", line 22, in <module> from tensorflow.python.tools.api.generator import doc_srcs File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/__init__.py", line 37, in <module> from tensorflow.python.eager import context File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/eager/context.py", line 28, in <module> from tensorflow.core.framework import function_pb2 File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/create_tensorflow.python_api_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/core/framework/function_pb2.py", line 5, in <module> from google.protobuf.internal import builder as _builder ModuleNotFoundError: No module named 'google.protobuf' Target //tensorflow/tools/pip_package:build_pip_package failed to build Use --verbose_failures to see the command lines of failed build steps. ERROR: /tf/tensorflow/tensorflow/tools/pip_package/BUILD:276:10 Middleman _middlemen/tensorflow_Stools_Spip_Upackage_Sbuild_Upip_Upackage-runfiles failed: (Exit 1): bash failed: error executing command /bin/bash -c ... (remaining 1 argument skipped) INFO: Elapsed time: 1951.697s, Critical Path: 1123.49s INFO: 23560 processes: 15975 disk cache hit, 5544 internal, 2041 local. FAILED: Build did NOT complete successfully FAILED: Build did NOT complete successfully stderr_lines: <omitted> stdout: '' stdout_lines: <omitted> PLAY RECAP ********************************************************************* localhost : ok=27 changed=20 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0 Thursday 23 February 2023 18:43:53 +0000 (0:32:32.862) 0:33:49.190 ***** =============================================================================== tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 1952.86s tensorflow_in_container : (Python 3.8) install Python packages --------- 30.58s tensorflow : Fetch TensorFlow from git --------------------------------- 22.49s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.66s tensorflow_in_container : (Python 3.8) start build container ------------ 3.40s Gathering Facts --------------------------------------------------------- 1.61s Create cache dirs ------------------------------------------------------- 1.38s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.22s tensorflow : Save git commit hash to file ------------------------------- 1.12s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.84s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.83s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.82s tensorflow : Create readme file about unit tests ------------------------ 0.73s tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.72s tensorflow : Create linklibs shell script ------------------------------- 0.69s Build TensorFlow for each Python version (dual abi) --------------------- 0.63s tensorflow_in_container : Reset checkout to clean state ----------------- 0.63s tensorflow : Get oneline version of git log for this checkout ----------- 0.58s tensorflow : Add to the copied files ------------------------------------ 0.56s Build step 'Execute shell' marked build as failure

1 year, 2 months

1
0
0 0

2024

2023

2022

2021

ldcg-ai-ml