See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/1143/display/redirect
Changes:
------------------------------------------ [...truncated 319.62 KiB...] [19,199 / 19,707] Compiling tensorflow/dtensor/cc/dtensor_graph_to_mlir_pass.cc; 73s local, remote-cache ... (112 actions running) [19,201 / 19,707] Compiling tensorflow/dtensor/cc/dtensor_graph_to_mlir_pass.cc; 74s local, remote-cache ... (112 actions running) [19,204 / 19,707] Compiling tensorflow/dtensor/cc/dtensor_graph_to_mlir_pass.cc; 75s local, remote-cache ... (112 actions running) [19,205 / 19,707] Compiling tensorflow/dtensor/cc/dtensor_graph_to_mlir_pass.cc; 76s local, remote-cache ... (111 actions, 110 running) [19,206 / 19,707] Compiling tensorflow/dtensor/cc/dtensor_graph_to_mlir_pass.cc; 78s local, remote-cache ... (112 actions running) [19,207 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/strided_slice_spmd_expander.cc; 57s local, remote-cache ... (111 actions, 110 running) [19,210 / 19,707] Compiling tensorflow/dtensor/mlir/propagate_device_id_to_function_args.cc; 57s local, remote-cache ... (111 actions, 110 running) [19,212 / 19,707] Compiling tensorflow/dtensor/mlir/propagate_device_id_to_function_args.cc; 59s local, remote-cache ... (112 actions running) [19,216 / 19,707] Compiling tensorflow/dtensor/mlir/propagate_default_layout.cc; 59s local, remote-cache ... (112 actions running) [19,217 / 19,707] Compiling tensorflow/dtensor/mlir/propagate_default_layout.cc; 60s local, remote-cache ... (112 actions running) [19,217 / 19,707] Compiling tensorflow/dtensor/mlir/propagate_default_layout.cc; 63s local, remote-cache ... (112 actions running) [19,220 / 19,707] Compiling tensorflow/dtensor/mlir/mesh_propagation.cc; 57s local, remote-cache ... (112 actions running) [19,221 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/argmax_spmd_expander.cc; 50s local, remote-cache ... (112 actions running) [19,222 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/softmax_spmd_expander.cc; 50s local, remote-cache ... (111 actions, 110 running) [19,224 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/softmax_spmd_expander.cc; 51s local, remote-cache ... (112 actions running) [19,225 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/softmax_spmd_expander.cc; 53s local, remote-cache ... (111 actions, 110 running) [19,227 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/softmax_spmd_expander.cc; 55s local, remote-cache ... (112 actions running) [19,229 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/softmax_spmd_expander.cc; 56s local, remote-cache ... (112 actions running) [19,233 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/softmax_spmd_expander.cc; 57s local, remote-cache ... (112 actions running) [19,234 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/slice_spmd_expander.cc; 58s local, remote-cache ... (112 actions running) [19,236 / 19,707] Compiling tensorflow/dtensor/mlir/merge_clusters.cc; 57s local, remote-cache ... (112 actions running) [19,236 / 19,707] Compiling tensorflow/dtensor/mlir/merge_clusters.cc; 58s local, remote-cache ... (112 actions running) [19,237 / 19,707] Compiling tensorflow/dtensor/mlir/merge_clusters.cc; 59s local, remote-cache ... (112 actions running) [19,241 / 19,707] Compiling tensorflow/dtensor/mlir/merge_clusters.cc; 60s local, remote-cache ... (111 actions, 110 running) [19,243 / 19,707] Compiling tensorflow/dtensor/mlir/merge_clusters.cc; 61s local, remote-cache ... (112 actions running) [19,244 / 19,707] Compiling tensorflow/dtensor/mlir/merge_clusters.cc; 63s local, remote-cache ... (111 actions, 110 running) [19,244 / 19,707] Compiling tensorflow/dtensor/mlir/merge_clusters.cc; 64s local, remote-cache ... (112 actions running) [19,247 / 19,707] Compiling tensorflow/dtensor/mlir/layout_propagation_v2.cc; 63s local, remote-cache ... (111 actions, 110 running) [19,248 / 19,707] Compiling tensorflow/dtensor/mlir/layout_propagation_v2.cc; 64s local, remote-cache ... (112 actions running) [19,249 / 19,707] Compiling tensorflow/dtensor/mlir/layout_propagation_v2.cc; 66s local, remote-cache ... (111 actions, 110 running) [19,249 / 19,707] Compiling tensorflow/dtensor/mlir/layout_propagation_v2.cc; 67s local, remote-cache ... (112 actions running) [19,252 / 19,707] Compiling tensorflow/dtensor/mlir/layout_propagation_v2.cc; 68s local, remote-cache ... (112 actions running) [19,254 / 19,707] Compiling tensorflow/dtensor/mlir/layout_propagation_v2.cc; 69s local, remote-cache ... (112 actions running) [19,255 / 19,707] Compiling tensorflow/dtensor/mlir/layout_propagation_v2.cc; 70s local, remote-cache ... (112 actions running) [19,256 / 19,707] Compiling tensorflow/dtensor/mlir/layout_propagation_v2.cc; 72s local, remote-cache ... (111 actions, 110 running) [19,256 / 19,707] Compiling tensorflow/dtensor/mlir/layout_propagation_v2.cc; 74s local, remote-cache ... (112 actions running) [19,259 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/random_op_spmd_expander.cc; 57s local, remote-cache ... (110 actions running) [19,260 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/random_op_spmd_expander.cc; 58s local, remote-cache ... (112 actions running) [19,261 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/random_op_spmd_expander.cc; 59s local, remote-cache ... (112 actions running) [19,263 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/random_op_spmd_expander.cc; 60s local, remote-cache ... (112 actions running) [19,264 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/random_op_spmd_expander.cc; 61s local, remote-cache ... (112 actions running) [19,268 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/random_op_spmd_expander.cc; 62s local, remote-cache ... (112 actions running) [19,269 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/meta_spmd_expander.cc; 59s local, remote-cache ... (112 actions running) [19,270 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/meta_spmd_expander.cc; 61s local, remote-cache ... (111 actions, 110 running) [19,270 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/meta_spmd_expander.cc; 63s local, remote-cache ... (112 actions running) [19,271 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/meta_spmd_expander.cc; 64s local, remote-cache ... (112 actions running) [19,273 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/meta_spmd_expander.cc; 65s local, remote-cache ... (112 actions running) [19,276 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/meta_spmd_expander.cc; 66s local, remote-cache ... (111 actions, 110 running) [19,277 / 19,707] Compiling tensorflow/dtensor/mlir/dtensor_allreduce_combine_optimization.cc; 58s local, remote-cache ... (112 actions running) [19,279 / 19,707] Compiling tensorflow/dtensor/mlir/dtensor_allreduce_combine_optimization.cc; 59s local, remote-cache ... (112 actions running) [19,279 / 19,707] Compiling tensorflow/dtensor/mlir/dtensor_allreduce_combine_optimization.cc; 61s local, remote-cache ... (112 actions running) [19,283 / 19,707] Compiling tensorflow/dtensor/mlir/dtensor_allreduce_combine_optimization.cc; 62s local, remote-cache ... (112 actions running) [19,288 / 19,707] Compiling tensorflow/dtensor/mlir/dtensor_allreduce_combine_optimization.cc; 63s local, remote-cache ... (112 actions running) [19,290 / 19,707] Compiling tensorflow/dtensor/mlir/dtensor_allreduce_combine_optimization.cc; 64s local, remote-cache ... (112 actions running) [19,291 / 19,707] Compiling tensorflow/dtensor/mlir/dtensor_allreduce_combine_optimization.cc; 66s local, remote-cache ... (111 actions, 110 running) [19,292 / 19,707] Compiling tensorflow/dtensor/mlir/dtensor_allreduce_combine_optimization.cc; 67s local, remote-cache ... (112 actions running) [19,295 / 19,707] Compiling tensorflow/dtensor/mlir/constant_folding.cc; 61s local, remote-cache ... (112 actions running) [19,297 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/fft_spmd_expander.cc; 58s local, remote-cache ... (112 actions running) [19,298 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/fft_spmd_expander.cc; 59s local, remote-cache ... (111 actions, 110 running) [19,300 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/elementwise_spmd_expander.cc; 59s local, remote-cache ... (111 actions, 110 running) [19,304 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/bias_add_spmd_expander.cc; 57s local, remote-cache ... (111 actions, 110 running) [19,305 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/bias_add_spmd_expander.cc; 58s local, remote-cache ... (112 actions running) [19,305 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/bias_add_spmd_expander.cc; 61s local, remote-cache ... (112 actions running) [19,309 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/bias_add_spmd_expander.cc; 62s local, remote-cache ... (112 actions running) [19,313 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/bias_add_spmd_expander.cc; 63s local, remote-cache ... (111 actions, 110 running) [19,316 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/einsum_spmd_expander.cc; 60s local, remote-cache ... (112 actions running) [19,322 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/dtensor_op_spmd_expander.cc; 58s local, remote-cache ... (111 actions, 110 running) [19,328 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/dataparallel_spmd_expander.cc; 58s local, remote-cache ... (112 actions running) [19,328 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/dataparallel_spmd_expander.cc; 59s local, remote-cache ... (112 actions running) [19,332 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/dataparallel_spmd_expander.cc; 60s local, remote-cache ... (111 actions, 110 running) [19,333 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/conv_spmd_expander.cc; 57s local, remote-cache ... (112 actions running) [19,336 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/conv_spmd_expander.cc; 58s local, remote-cache ... (112 actions running) [19,337 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/conv_spmd_expander.cc; 60s local, remote-cache ... (111 actions, 110 running) [19,341 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/conv_spmd_expander.cc; 61s local, remote-cache ... (111 actions, 110 running) [19,344 / 19,707] Compiling tensorflow/dtensor/mlir/expansions/conv_spmd_expander.cc; 62s local, remote-cache ... (112 actions running) [19,353 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/concat_op.cc; 43s local, remote-cache ... (112 actions running) [19,354 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/concat_op.cc; 44s local, remote-cache ... (112 actions running) [19,356 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/concat_op.cc; 45s local, remote-cache ... (112 actions running) [19,358 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/roll_op.cc; 42s local, remote-cache ... (112 actions running) [19,359 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/reverse_sequence_op.cc; 42s local, remote-cache ... (111 actions, 110 running) [19,364 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/reshape_op.cc; 41s local, remote-cache ... (112 actions running) [19,370 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/relu_op.cc; 40s local, remote-cache ... (112 actions running) [19,370 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/relu_op.cc; 41s local, remote-cache ... (112 actions running) [19,372 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/relu_op.cc; 42s local, remote-cache ... (112 actions running) [19,373 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/relu_op.cc; 44s local, remote-cache ... (111 actions, 110 running) [19,378 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/random_ops_util.cc; 42s local, remote-cache ... (112 actions running) [19,379 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/reduction_ops_common.cc; 43s local, remote-cache ... (111 actions, 110 running) [19,382 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/reduction_ops_common.cc; 44s local, remote-cache ... (111 actions, 110 running) [19,389 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/pooling_ops.cc; 44s local, remote-cache ... (112 actions running) [19,392 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/one_hot_op.cc; 41s local, remote-cache ... (112 actions running) [19,395 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/mirror_pad_op.cc; 40s local, remote-cache ... (112 actions running) [19,396 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/mirror_pad_op.cc; 41s local, remote-cache ... (112 actions running) [19,397 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/mirror_pad_op.cc; 42s local, remote-cache ... (112 actions running) [19,401 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/matrix_triangular_solve_op.cc; 41s local, remote-cache ... (112 actions running) [19,404 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/matrix_triangular_solve_op.cc; 42s local, remote-cache ... (112 actions running) [19,405 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/matrix_triangular_solve_op.cc; 44s local, remote-cache ... (111 actions, 110 running) [19,406 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/matrix_triangular_solve_op.cc; 45s local, remote-cache ... (112 actions running) [19,407 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/matrix_band_part_op.cc; 40s local, remote-cache ... (112 actions running) [19,411 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/matrix_band_part_op.cc; 41s local, remote-cache ... (112 actions running) [19,416 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/listdiff_op.cc; 40s local, remote-cache ... (112 actions running) [19,417 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/listdiff_op.cc; 41s local, remote-cache ... (111 actions, 110 running) [19,425 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/listdiff_op.cc; 42s local, remote-cache ... (111 actions, 110 running) [19,428 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/listdiff_op.cc; 44s local, remote-cache ... (112 actions running) [19,432 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/listdiff_op.cc; 45s local, remote-cache ... (112 actions running) [19,439 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/variable_ops.cc; 40s local, remote-cache ... (112 actions running) [19,440 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/variable_ops.cc; 41s local, remote-cache ... (112 actions running) [19,442 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/variable_ops.cc; 42s local, remote-cache ... (112 actions running) [19,443 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/fake_quantize_ops.cc; 43s local, remote-cache ... (111 actions, 110 running) [19,444 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/fake_quantize_ops.cc; 45s local, remote-cache ... (112 actions running) [19,446 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/fake_quantize_ops.cc; 46s local, remote-cache ... (111 actions, 110 running) [19,450 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/extract_image_patches_op.cc; 44s local, remote-cache ... (111 actions, 110 running) [19,459 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/extract_image_patches_op.cc; 45s local, remote-cache ... (112 actions running) [19,462 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/extract_image_patches_op.cc; 46s local, remote-cache ... (111 actions, 110 running) [19,463 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/extract_image_patches_op.cc; 47s local, remote-cache ... (112 actions running) [19,468 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/dynamic_partition_op.cc; 45s local, remote-cache ... (111 actions, 110 running) [19,468 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/dynamic_partition_op.cc; 46s local, remote-cache ... (112 actions running) [19,473 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/dequantize_op.cc; 41s local, remote-cache ... (111 actions, 110 running) [19,474 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/dequantize_op.cc; 42s local, remote-cache ... (112 actions running) [19,476 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/dequantize_op.cc; 43s local, remote-cache ... (112 actions running) [19,479 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/cross_op.cc; 43s local, remote-cache ... (111 actions, 110 running) [19,480 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/cross_op.cc; 44s local, remote-cache ... (112 actions running) [19,482 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/conv_ops.cc; 44s local, remote-cache ... (110 actions running) [19,487 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/conv_ops.cc; 45s local, remote-cache ... (111 actions, 110 running) [19,491 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/clip_by_value_op.cc; 42s local, remote-cache ... (112 actions running) [19,492 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/clip_by_value_op.cc; 44s local, remote-cache ... (112 actions running) [19,495 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/clip_by_value_op.cc; 45s local, remote-cache ... (112 actions running) [19,498 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/categorical_op.cc; 43s local, remote-cache ... (111 actions, 110 running) [19,499 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/categorical_op.cc; 44s local, remote-cache ... (112 actions running) [19,500 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/categorical_op.cc; 45s local, remote-cache ... (112 actions running) [19,501 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/categorical_op.cc; 46s local, remote-cache ... (112 actions running) [19,503 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/categorical_op.cc; 48s local, remote-cache ... (111 actions, 110 running) [19,506 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/cast_op.cc; 48s local, remote-cache ... (112 actions running) [19,509 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/cast_op.cc; 49s local, remote-cache ... (112 actions running) [19,515 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/bucketize_op.cc; 50s local, remote-cache ... (111 actions, 110 running) [19,519 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/batch_matmul_op.cc; 46s local, remote-cache ... (112 actions running) [19,521 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/batch_matmul_op.cc; 47s local, remote-cache ... (112 actions running) [19,525 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/batch_matmul_op.cc; 48s local, remote-cache ... (112 actions running) [19,526 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/batch_matmul_op.cc; 50s local, remote-cache ... (111 actions, 110 running) [19,529 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/stateless_random_ops_v2.cc; 47s local, remote-cache ... (111 actions, 110 running) [19,530 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/stateless_random_ops.cc; 47s local, remote-cache ... (111 actions, 110 running) [19,534 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/stateless_random_ops.cc; 48s local, remote-cache ... (111 actions, 110 running) [19,538 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/stateless_random_ops.cc; 49s local, remote-cache ... (111 actions, 110 running) [19,544 / 19,707] Compiling tensorflow/compiler/tf2xla/kernels/stateless_random_ops.cc; 50s local, remote-cache ... (111 actions, 110 running) [19,551 / 19,707] Compiling tensorflow/compiler/tf2xla/tf2xla.cc; 47s local, remote-cache ... (105 actions, 104 running) [19,556 / 19,707] Compiling tensorflow/compiler/tf2xla/tf2xla.cc; 48s local, remote-cache ... (100 actions running) [19,561 / 19,707] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 50s local, remote-cache ... (93 actions, 92 running) [19,566 / 19,707] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 51s local, remote-cache ... (88 actions running) [19,572 / 19,707] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 52s local, remote-cache ... (81 actions, 80 running) [19,579 / 19,707] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 54s local, remote-cache ... (75 actions, 74 running) [19,586 / 19,707] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 55s local, remote-cache ... (68 actions running) [19,588 / 19,707] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 56s local, remote-cache ... (66 actions running) [19,589 / 19,707] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 57s local, remote-cache ... (65 actions, 64 running) [19,594 / 19,707] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 59s local, remote-cache ... (60 actions running) [19,600 / 19,707] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 61s local, remote-cache ... (52 actions running) [19,605 / 19,707] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 62s local, remote-cache ... (47 actions, 46 running) [19,612 / 19,707] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 64s local, remote-cache ... (40 actions running) [19,613 / 19,707] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 65s local, remote-cache ... (39 actions, 38 running) [19,615 / 19,707] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 67s local, remote-cache ... (37 actions, 36 running) [19,619 / 19,707] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 68s local, remote-cache ... (32 actions running) [19,622 / 19,707] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 69s local, remote-cache ... (28 actions running) [19,626 / 19,707] Compiling tensorflow/compiler/jit/xla_compile_on_demand_op.cc; 70s local, remote-cache ... (23 actions, 22 running) [19,631 / 19,707] Compiling tensorflow/compiler/tf2xla/mlir_tf2xla.cc; 69s local, remote-cache ... (16 actions running) [19,632 / 19,707] Compiling tensorflow/compiler/tf2xla/mlir_tf2xla.cc; 70s local, remote-cache ... (14 actions running) [19,634 / 19,707] Compiling tensorflow/compiler/tf2xla/mlir_tf2xla.cc; 72s local, remote-cache ... (12 actions running) [19,637 / 19,707] Compiling tensorflow/compiler/tf2xla/mlir_tf2xla.cc; 73s local, remote-cache ... (9 actions, 8 running) [19,638 / 19,707] Compiling tensorflow/compiler/tf2xla/mlir_tf2xla.cc; 75s local, remote-cache ... (8 actions running) [19,638 / 19,707] Compiling tensorflow/compiler/tf2xla/mlir_tf2xla.cc; 78s local, remote-cache ... (8 actions running) [19,640 / 19,707] Compiling tensorflow/compiler/mlir/python/mlir.cc; 67s local, remote-cache ... (6 actions running) [19,641 / 19,707] Compiling tensorflow/compiler/mlir/python/mlir.cc; 74s local, remote-cache ... (5 actions, 4 running) [19,642 / 19,707] Compiling tensorflow/compiler/mlir/python/mlir.cc; 75s local, remote-cache ... (4 actions running) [19,642 / 19,707] Compiling tensorflow/compiler/mlir/python/mlir.cc; 85s local, remote-cache ... (4 actions running) [19,643 / 19,707] Compiling tensorflow/compiler/mlir/python/mlir.cc; 95s local, remote-cache ... (3 actions, 2 running) [19,644 / 19,707] Compiling tensorflow/compiler/mlir/python/mlir.cc; 96s local, remote-cache [19,644 / 19,707] Compiling tensorflow/compiler/mlir/python/mlir.cc; 106s local, remote-cache [19,645 / 19,707] [Prepa] Linking tensorflow/compiler/mlir/python/libmlir.pic.lo [19,646 / 19,707] Linking tensorflow/libtensorflow_cc.so.2.17.0; 1s local, remote-cache [19,646 / 19,707] Linking tensorflow/libtensorflow_cc.so.2.17.0; 11s local, remote-cache [19,646 / 19,707] Linking tensorflow/libtensorflow_cc.so.2.17.0; 41s local, remote-cache [19,646 / 19,707] Linking tensorflow/libtensorflow_cc.so.2.17.0; 101s local, remote-cache [19,646 / 19,707] Linking tensorflow/libtensorflow_cc.so.2.17.0; 161s local, remote-cache [19,646 / 19,707] Linking tensorflow/libtensorflow_cc.so.2.17.0; 221s local, remote-cache [19,646 / 19,707] Linking tensorflow/libtensorflow_cc.so.2.17.0; 281s local, remote-cache [19,646 / 19,707] Linking tensorflow/libtensorflow_cc.so.2.17.0; 341s local, remote-cache [19,646 / 19,707] Linking tensorflow/libtensorflow_cc.so.2.17.0; 401s local, remote-cache [19,646 / 19,707] Linking tensorflow/libtensorflow_cc.so.2.17.0; 461s local, remote-cache [19,646 / 19,707] Linking tensorflow/libtensorflow_cc.so.2.17.0; 521s local, remote-cache [19,646 / 19,707] Linking tensorflow/libtensorflow_cc.so.2.17.0; 581s local, remote-cache [19,646 / 19,707] Linking tensorflow/libtensorflow_cc.so.2.17.0; 641s local, remote-cache [19,646 / 19,707] Linking tensorflow/libtensorflow_cc.so.2.17.0; 701s local, remote-cache [19,646 / 19,707] Linking tensorflow/libtensorflow_cc.so.2.17.0; 761s local, remote-cache [19,646 / 19,707] Linking tensorflow/libtensorflow_cc.so.2.17.0; 784s local, remote-cache [19,646 / 19,707] Linking tensorflow/libtensorflow_cc.so.2.17.0; 786s local, remote-cache [19,650 / 19,707] Linking tensorflow/python/_pywrap_tensorflow_internal.so; 1s local, remote-cache [19,651 / 19,707] [Prepa] action 'SolibSymlink _solib_local/_Utensorflow_Spython/_pywrap_tensorflow_internal.so' [19,698 / 19,707] Linking tensorflow/python/_pywrap_py_exception_registry.so; 1s local, remote-cache ... (16 actions running) [19,701 / 19,707] Linking tensorflow/python/_pywrap_py_exception_registry.so; 2s local, remote-cache ... (10 actions running) [19,705 / 19,707] Linking tensorflow/python/tpu/_pywrap_tpu_embedding.so; 4s local, remote-cache [19,706 / 19,707] [Prepa] Action tensorflow/tools/pip_package/wheel_house [19,706 / 19,707] Action tensorflow/tools/pip_package/wheel_house; 1s local, remote-cache [19,706 / 19,707] Action tensorflow/tools/pip_package/wheel_house; 11s local, remote-cache ERROR: /tf/tensorflow/tensorflow/tools/pip_package/BUILD:265:9: Action tensorflow/tools/pip_package/wheel_house failed: (Exit 1): build_pip_package_py failed: error executing command (from target //tensorflow/tools/pip_package:wheel) bazel-out/aarch64-opt-exec-50AE0418/bin/tensorflow/tools/pip_package/build_pip_package_py @bazel-out/aarch64-opt/bin/tensorflow/tools/pip_package/wheel_house-0.params patchelf: getting info about '/tmp/tensorflow_wheelh0516k5t/tensorflow/compiler/mlir/quantization/tensorflow/calibrator/pywrap_calibration.so': No such file or directory Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt-exec-50AE0418/bin/tensorflow/tools/pip_package/build_pip_package_py.runfiles/org_tensorflow/tensorflow/tools/pip_package/build_pip_package.py", line 340, in <module> prepare_wheel_srcs(args.headers, args.srcs, args.xla_aot, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt-exec-50AE0418/bin/tensorflow/tools/pip_package/build_pip_package_py.runfiles/org_tensorflow/tensorflow/tools/pip_package/build_pip_package.py", line 197, in prepare_wheel_srcs patch_so(srcs_dir) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt-exec-50AE0418/bin/tensorflow/tools/pip_package/build_pip_package_py.runfiles/org_tensorflow/tensorflow/tools/pip_package/build_pip_package.py", line 239, in patch_so rpath = subprocess.check_output( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/external/python_aarch64-unknown-linux-gnu/lib/python3.9/subprocess.py", line 424, in check_output return run(*popenargs, stdout=PIPE, timeout=timeout, check=True, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/external/python_aarch64-unknown-linux-gnu/lib/python3.9/subprocess.py", line 528, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['patchelf', '--print-rpath', '/tmp/tensorflow_wheelh0516k5t/tensorflow/compiler/mlir/quantization/tensorflow/calibrator/pywrap_calibration.so']' returned non-zero exit status 1. Target //tensorflow/tools/pip_package:wheel failed to build Use --verbose_failures to see the command lines of failed build steps. INFO: Elapsed time: 3788.668s, Critical Path: 1478.44s INFO: 19707 processes: 1223 internal, 18484 local. FAILED: Build did NOT complete successfully stderr_lines: <omitted> stdout: '' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=25 changed=17 unreachable=0 failed=1 skipped=6 rescued=0 ignored=0
Wednesday 17 April 2024 20:14:47 +0100 (1:03:10.124) 1:04:43.153 ******* =============================================================================== tensorflow_in_container : (Python 3.9) build TensorFlow git ---------- 3790.12s tensorflow_in_container : (Python 3.9) start build container ----------- 38.79s tensorflow : Fetch TensorFlow from git --------------------------------- 23.21s Cleanup after previous build ------------------------------------------- 11.59s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.58s tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 1.81s Gathering Facts --------------------------------------------------------- 1.63s tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.53s Create cache dirs ------------------------------------------------------- 1.40s tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.17s tensorflow : Save git commit hash to file ------------------------------- 1.14s tensorflow_in_container : (Python 3.9) create link for pip cache -------- 0.83s tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 0.83s tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.77s tensorflow : Create linklibs shell script ------------------------------- 0.69s tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds --- 0.68s tensorflow_in_container : Reset checkout to clean state ----------------- 0.65s tensorflow : Use nightly package requirements --------------------------- 0.63s tensorflow : Get oneline version of git log for this checkout ----------- 0.58s Build TensorFlow for each Python version (dual abi) --------------------- 0.43s Build step 'Execute shell' marked build as failure