See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/343/display/redirect
Changes:
------------------------------------------ [...truncated 131.84 MB...] //tensorflow/compiler/tests:conv2d_test_cpu PASSED in 54.0s Stats over 10 runs: max = 54.0s, min = 46.1s, avg = 50.7s, dev = 2.7s //tensorflow/compiler/tests:conv2d_test_cpu_mlir_bridge_test PASSED in 7.6s Stats over 10 runs: max = 7.6s, min = 5.8s, avg = 6.6s, dev = 0.5s //tensorflow/compiler/tests:image_ops_test_cpu PASSED in 19.6s Stats over 10 runs: max = 19.6s, min = 13.9s, avg = 16.6s, dev = 2.1s //tensorflow/compiler/tests:random_ops_test_cpu PASSED in 12.0s Stats over 10 runs: max = 12.0s, min = 6.4s, avg = 8.8s, dev = 1.7s //tensorflow/compiler/tests:random_ops_test_cpu_mlir_bridge_test PASSED in 11.3s Stats over 10 runs: max = 11.3s, min = 4.1s, avg = 7.5s, dev = 2.3s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 68.6s Stats over 10 runs: max = 68.6s, min = 5.4s, avg = 38.9s, dev = 19.4s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 80.5s Stats over 10 runs: max = 80.5s, min = 5.7s, avg = 41.9s, dev = 21.4s //tensorflow/compiler/xla/client/lib:svd_test_cpu PASSED in 54.1s Stats over 10 runs: max = 54.1s, min = 4.3s, avg = 19.2s, dev = 18.5s //tensorflow/compiler/xla/client/lib:tridiagonal_test_cpu PASSED in 5.5s Stats over 10 runs: max = 5.5s, min = 4.5s, avg = 5.0s, dev = 0.3s //tensorflow/compiler/xla/service/cpu:cpu_runtime_test PASSED in 5.8s Stats over 10 runs: max = 5.8s, min = 1.0s, avg = 4.7s, dev = 1.8s //tensorflow/python:special_math_ops_test_cpu PASSED in 41.1s Stats over 10 runs: max = 41.1s, min = 4.3s, avg = 11.7s, dev = 10.2s //tensorflow/python/data/kernel_tests:rejection_resample_test PASSED in 19.1s Stats over 10 runs: max = 19.1s, min = 4.5s, avg = 10.0s, dev = 4.6s //tensorflow/python/distribute:input_lib_test_2gpu PASSED in 26.3s Stats over 10 runs: max = 26.3s, min = 21.2s, avg = 24.1s, dev = 1.6s //tensorflow/python/distribute:input_lib_test_cpu PASSED in 29.9s Stats over 10 runs: max = 29.9s, min = 19.1s, avg = 24.2s, dev = 3.1s //tensorflow/python/distribute:input_lib_type_spec_test_2gpu PASSED in 17.7s Stats over 10 runs: max = 17.7s, min = 5.8s, avg = 12.2s, dev = 4.2s //tensorflow/python/distribute:input_lib_type_spec_test_cpu PASSED in 17.2s Stats over 10 runs: max = 17.2s, min = 7.3s, avg = 11.7s, dev = 3.2s //tensorflow/python/framework:function_test_cpu PASSED in 57.0s Stats over 10 runs: max = 57.0s, min = 5.9s, avg = 12.6s, dev = 15.0s //tensorflow/python/grappler:cluster_test_cpu PASSED in 6.5s Stats over 10 runs: max = 6.5s, min = 2.9s, avg = 4.5s, dev = 1.3s //tensorflow/python/keras/mixed_precision:layer_correctness_test_cpu PASSED in 58.0s Stats over 10 runs: max = 58.0s, min = 29.2s, avg = 39.2s, dev = 9.2s //tensorflow/python/kernel_tests/array_ops:array_ops_test_cpu PASSED in 10.4s Stats over 10 runs: max = 10.4s, min = 7.8s, avg = 8.9s, dev = 1.0s //tensorflow/python/kernel_tests/array_ops:inplace_ops_test_cpu PASSED in 7.5s Stats over 10 runs: max = 7.5s, min = 5.0s, avg = 6.2s, dev = 0.9s //tensorflow/python/kernel_tests/data_structures:tensor_array_ops_test_cpu PASSED in 9.5s Stats over 10 runs: max = 9.5s, min = 5.2s, avg = 7.3s, dev = 1.3s //tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test_cpu PASSED in 129.4s Stats over 10 runs: max = 129.4s, min = 110.0s, avg = 119.9s, dev = 5.7s //tensorflow/python/kernel_tests/linalg:linear_operator_kronecker_test_cpu PASSED in 73.9s Stats over 10 runs: max = 73.9s, min = 58.1s, avg = 65.2s, dev = 4.6s //tensorflow/python/kernel_tests/linalg:linear_operator_low_rank_update_test_cpu PASSED in 171.1s Stats over 10 runs: max = 171.1s, min = 133.7s, avg = 153.4s, dev = 12.4s //tensorflow/python/kernel_tests/linalg:tridiagonal_matmul_op_test_cpu PASSED in 77.4s Stats over 10 runs: max = 77.4s, min = 2.8s, avg = 12.0s, dev = 21.8s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_ops_test_cpu PASSED in 94.8s Stats over 10 runs: max = 94.8s, min = 22.3s, avg = 41.0s, dev = 26.5s //tensorflow/python/kernel_tests/math_ops:segment_reduction_ops_test_cpu PASSED in 70.7s Stats over 10 runs: max = 70.7s, min = 5.6s, avg = 16.0s, dev = 19.6s //tensorflow/python/kernel_tests/nn_ops:pooling_ops_test_cpu PASSED in 27.3s Stats over 10 runs: max = 27.3s, min = 6.6s, avg = 15.6s, dev = 8.5s //tensorflow/python/kernel_tests/nn_ops:rnn_test_cpu PASSED in 54.3s Stats over 10 runs: max = 54.3s, min = 49.5s, avg = 52.1s, dev = 1.4s //tensorflow/python/kernel_tests/random:random_index_shuffle_test PASSED in 6.7s Stats over 10 runs: max = 6.7s, min = 2.9s, avg = 4.0s, dev = 1.4s //tensorflow/python/kernel_tests/random:stateless_random_ops_test_cpu PASSED in 124.1s Stats over 10 runs: max = 124.1s, min = 100.3s, avg = 110.4s, dev = 8.0s //tensorflow/python/saved_model:load_test_cpu PASSED in 46.2s Stats over 10 runs: max = 46.2s, min = 22.8s, avg = 28.3s, dev = 6.4s //tensorflow/compiler/tests:fft_test_cpu PASSED in 20.8s Stats over 12 runs: max = 20.8s, min = 4.8s, avg = 12.0s, dev = 5.7s //tensorflow/python/data/experimental/kernel_tests:group_by_reducer_test PASSED in 15.5s Stats over 12 runs: max = 15.5s, min = 3.5s, avg = 9.2s, dev = 3.8s //tensorflow/python/data/kernel_tests:memory_cleanup_test_cpu PASSED in 53.5s Stats over 12 runs: max = 53.5s, min = 42.1s, avg = 47.6s, dev = 3.3s //tensorflow/python/distribute:multi_process_runner_test_2gpu PASSED in 221.4s Stats over 12 runs: max = 221.4s, min = 10.8s, avg = 48.3s, dev = 58.2s //tensorflow/python/distribute:multi_process_runner_test_cpu PASSED in 221.0s Stats over 12 runs: max = 221.0s, min = 10.6s, avg = 48.4s, dev = 58.1s //tensorflow/python/distribute:random_generator_test_2gpu PASSED in 61.5s Stats over 12 runs: max = 61.5s, min = 20.5s, avg = 41.1s, dev = 11.8s //tensorflow/python/distribute:random_generator_test_cpu PASSED in 60.5s Stats over 12 runs: max = 60.5s, min = 20.6s, avg = 42.7s, dev = 11.8s //tensorflow/python/keras/layers:gru_v2_test_cpu PASSED in 62.6s Stats over 12 runs: max = 62.6s, min = 24.7s, avg = 36.9s, dev = 12.5s //tensorflow/python/keras/layers:recurrent_test PASSED in 60.6s Stats over 12 runs: max = 60.6s, min = 27.7s, avg = 43.1s, dev = 11.2s //tensorflow/python/kernel_tests/image_ops:extract_image_patches_grad_test_cpu PASSED in 277.5s Stats over 15 runs: max = 277.5s, min = 2.7s, avg = 39.8s, dev = 70.3s //tensorflow/python/kernel_tests/nn_ops:rnn_cell_test_cpu PASSED in 54.6s Stats over 15 runs: max = 54.6s, min = 4.2s, avg = 12.4s, dev = 11.8s //tensorflow/python:image_ops_test_cpu PASSED in 20.2s Stats over 16 runs: max = 20.2s, min = 5.2s, avg = 11.3s, dev = 4.0s //tensorflow/python/data/experimental/kernel_tests/service:coordinated_read_ft_test PASSED in 41.9s Stats over 16 runs: max = 41.9s, min = 9.1s, avg = 16.3s, dev = 10.6s //tensorflow/python/data/experimental/kernel_tests/service:coordinated_read_test PASSED in 26.7s Stats over 16 runs: max = 26.7s, min = 6.8s, avg = 12.9s, dev = 4.4s //tensorflow/python/data/experimental/kernel_tests/service:dynamic_sharding_test PASSED in 19.7s Stats over 16 runs: max = 19.7s, min = 7.1s, avg = 13.2s, dev = 3.2s //tensorflow/python/data/experimental/kernel_tests/service:worker_tags_test PASSED in 17.9s Stats over 16 runs: max = 17.9s, min = 3.9s, avg = 11.1s, dev = 4.6s //tensorflow/python/data/kernel_tests:snapshot_test PASSED in 27.0s Stats over 16 runs: max = 27.0s, min = 10.4s, avg = 16.2s, dev = 4.6s //tensorflow/python/kernel_tests/control_flow:control_flow_ops_py_test_cpu PASSED in 27.1s Stats over 16 runs: max = 27.1s, min = 5.4s, avg = 10.5s, dev = 5.6s //tensorflow/python/kernel_tests/linalg:matrix_exponential_op_test PASSED in 10.0s Stats over 16 runs: max = 10.0s, min = 3.0s, avg = 5.7s, dev = 1.7s //tensorflow/python/kernel_tests/signal:dct_ops_test_cpu PASSED in 8.1s Stats over 16 runs: max = 8.1s, min = 4.1s, avg = 6.1s, dev = 1.4s //tensorflow/python/ops/parallel_for:control_flow_ops_test_cpu PASSED in 63.6s Stats over 16 runs: max = 63.6s, min = 11.4s, avg = 20.7s, dev = 12.0s //tensorflow/python/data/kernel_tests:map_test PASSED in 35.4s Stats over 19 runs: max = 35.4s, min = 12.0s, avg = 23.9s, dev = 6.1s //tensorflow/python/eager:function_test_cpu FLAKY, failed in 4 out of 19 in 18.5s Stats over 19 runs: max = 18.5s, min = 6.6s, avg = 13.2s, dev = 3.0s /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/eager/function_test_cpu/shard_2_of_15/test_attempts/attempt_1.log /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/eager/function_test_cpu/shard_14_of_15/test_attempts/attempt_1.log /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/eager/function_test_cpu/shard_1_of_15/test_attempts/attempt_1.log /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/eager/function_test_cpu/shard_1_of_15/test_attempts/attempt_2.log //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 6.6s Stats over 20 runs: max = 6.6s, min = 3.0s, avg = 4.5s, dev = 1.3s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 6.3s Stats over 20 runs: max = 6.3s, min = 2.8s, avg = 3.7s, dev = 1.1s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 11.6s Stats over 20 runs: max = 11.6s, min = 3.1s, avg = 4.8s, dev = 2.2s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 10.2s Stats over 20 runs: max = 10.2s, min = 2.7s, avg = 5.9s, dev = 2.1s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 5.7s Stats over 20 runs: max = 5.7s, min = 5.0s, avg = 5.3s, dev = 0.2s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 12.1s Stats over 20 runs: max = 12.1s, min = 8.3s, avg = 9.7s, dev = 1.0s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 13.1s Stats over 20 runs: max = 13.1s, min = 9.4s, avg = 11.3s, dev = 1.0s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 45.6s Stats over 20 runs: max = 45.6s, min = 6.3s, avg = 16.5s, dev = 12.7s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 20.7s Stats over 20 runs: max = 20.7s, min = 13.7s, avg = 17.7s, dev = 1.8s //tensorflow/python/kernel_tests:metrics_test PASSED in 40.8s Stats over 20 runs: max = 40.8s, min = 7.2s, avg = 18.5s, dev = 9.6s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 6.1s Stats over 20 runs: max = 6.1s, min = 2.9s, avg = 4.1s, dev = 1.2s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 9.4s Stats over 20 runs: max = 9.4s, min = 3.1s, avg = 5.5s, dev = 1.7s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 26.5s Stats over 20 runs: max = 26.5s, min = 2.8s, avg = 9.5s, dev = 7.8s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 66.2s Stats over 20 runs: max = 66.2s, min = 25.3s, avg = 39.0s, dev = 12.0s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 6.8s Stats over 20 runs: max = 6.8s, min = 3.7s, avg = 5.0s, dev = 1.0s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 10.4s Stats over 20 runs: max = 10.4s, min = 4.1s, avg = 6.3s, dev = 1.8s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 107.5s Stats over 20 runs: max = 107.5s, min = 32.1s, avg = 71.5s, dev = 25.5s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 14.3s Stats over 20 runs: max = 14.3s, min = 2.8s, avg = 7.1s, dev = 3.9s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 13.7s Stats over 20 runs: max = 13.7s, min = 5.3s, avg = 9.8s, dev = 2.5s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 26.2s Stats over 20 runs: max = 26.2s, min = 12.8s, avg = 19.9s, dev = 4.8s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 64.5s Stats over 20 runs: max = 64.5s, min = 6.0s, avg = 25.9s, dev = 19.3s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 22.8s Stats over 20 runs: max = 22.8s, min = 2.7s, avg = 5.3s, dev = 4.4s //tensorflow/python:nn_fused_batchnorm_test_cpu PASSED in 172.6s Stats over 24 runs: max = 172.6s, min = 2.7s, avg = 23.1s, dev = 43.5s //tensorflow/python/data/experimental/kernel_tests:directed_interleave_dataset_test PASSED in 18.4s Stats over 24 runs: max = 18.4s, min = 2.9s, avg = 8.0s, dev = 4.2s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 18.5s Stats over 24 runs: max = 18.5s, min = 5.4s, avg = 12.5s, dev = 3.9s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 23.0s Stats over 24 runs: max = 23.0s, min = 7.9s, avg = 14.7s, dev = 4.8s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 5.7s Stats over 25 runs: max = 5.7s, min = 4.4s, avg = 5.0s, dev = 0.3s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 4.8s Stats over 30 runs: max = 4.8s, min = 4.4s, avg = 4.6s, dev = 0.1s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 18.6s Stats over 30 runs: max = 18.6s, min = 15.5s, avg = 16.9s, dev = 0.7s //tensorflow/compiler/xla/tests:local_client_execute_test_cpu PASSED in 108.7s Stats over 30 runs: max = 108.7s, min = 6.1s, avg = 10.1s, dev = 18.3s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 7.2s Stats over 30 runs: max = 7.2s, min = 5.0s, avg = 6.2s, dev = 0.5s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 4.9s Stats over 30 runs: max = 4.9s, min = 4.4s, avg = 4.6s, dev = 0.1s //tensorflow/python/keras/engine:training_integration_test PASSED in 34.7s Stats over 30 runs: max = 34.7s, min = 8.1s, avg = 20.0s, dev = 8.0s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 14.9s Stats over 30 runs: max = 14.9s, min = 3.0s, avg = 7.3s, dev = 2.5s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 7.6s Stats over 31 runs: max = 7.6s, min = 6.2s, avg = 6.8s, dev = 0.4s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 6.1s Stats over 32 runs: max = 6.1s, min = 4.2s, avg = 4.5s, dev = 0.4s //tensorflow/python/data/experimental/kernel_tests/service:auto_shard_test PASSED in 15.2s Stats over 32 runs: max = 15.2s, min = 3.2s, avg = 9.0s, dev = 2.9s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 27.8s Stats over 32 runs: max = 27.8s, min = 6.2s, avg = 12.5s, dev = 5.3s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 10.0s Stats over 40 runs: max = 10.0s, min = 7.6s, avg = 8.4s, dev = 0.4s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 7.7s Stats over 40 runs: max = 7.7s, min = 6.0s, avg = 6.7s, dev = 0.4s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 16.6s Stats over 40 runs: max = 16.6s, min = 9.2s, avg = 12.7s, dev = 1.7s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 10.5s Stats over 40 runs: max = 10.5s, min = 4.7s, avg = 5.9s, dev = 1.0s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 9.1s Stats over 50 runs: max = 9.1s, min = 6.1s, avg = 7.3s, dev = 0.6s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 9.0s Stats over 50 runs: max = 9.0s, min = 6.7s, avg = 7.4s, dev = 0.4s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 11.6s Stats over 50 runs: max = 11.6s, min = 7.1s, avg = 8.4s, dev = 0.9s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 15.1s Stats over 50 runs: max = 15.1s, min = 4.4s, avg = 8.5s, dev = 2.9s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 6.6s Stats over 50 runs: max = 6.6s, min = 2.7s, avg = 3.5s, dev = 1.0s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 6.1s Stats over 50 runs: max = 6.1s, min = 2.8s, avg = 3.2s, dev = 0.6s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 27.1s Stats over 50 runs: max = 27.1s, min = 7.0s, avg = 14.3s, dev = 5.5s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 15.3s Stats over 50 runs: max = 15.3s, min = 3.1s, avg = 4.1s, dev = 1.8s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 10.7s Stats over 50 runs: max = 10.7s, min = 2.5s, avg = 4.0s, dev = 1.7s
Executed 3335 out of 3335 tests: 3334 tests pass and 1 fails locally. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=48 changed=30 unreachable=0 failed=1 skipped=10 rescued=0 ignored=0
Thursday 14 April 2022 16:26:10 +0000 (1:01:46.862) 1:45:46.784 ******** =============================================================================== tensorflow : Run unit tests on TensorFlow git for cp37-cp37m --------- 3706.86s tensorflow : build TensorFlow git for cp37-cp37m --------------------- 1872.70s python : build wheels of Python package Keras_Applications ------------ 271.98s python : build wheels of Python package h5py~=3.6.0 ------------------- 267.12s install bazel build requirements --------------------------------------- 41.13s tensorflow : populate cp37-cp37m virtualenv ---------------------------- 32.62s python : install numpy build requirements ------------------------------ 26.69s fetch tensorflow from git ---------------------------------------------- 22.52s python : create cp37-cp37m virtualenv ---------------------------------- 15.19s python : build wheels of Python package grpcio ------------------------- 11.33s python : install h5py build requirements ------------------------------- 11.06s install tensorflow build requirements ----------------------------------- 7.98s python : install scipy-1.7.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl Python package --- 7.49s python : build wheels of Python package scipy --------------------------- 6.90s python : install h5py-3.6.0-cp37-cp37m-linux_aarch64.whl Python package --- 5.16s tensorflow : remove TensorFlow git sources from previous build ---------- 4.95s python : build wheels of Python package Keras_Preprocessing ------------- 4.88s Gathering Facts --------------------------------------------------------- 4.60s python : enable EPEL ---------------------------------------------------- 3.27s python : build wheels of Python package numpy>=1.20 --------------------- 2.89s Build step 'Execute shell' marked build as failure