See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/236/display/redirect

Changes:

------------------------------------------ [...truncated 112.70 MB...] Stats over 8 runs: max = 88.6s, min = 73.1s, avg = 80.1s, dev = 5.4s //tensorflow/python/kernel_tests/linalg:linalg_ops_test PASSED in 51.1s Stats over 8 runs: max = 51.1s, min = 26.5s, avg = 39.1s, dev = 8.7s //tensorflow/python/kernel_tests/linalg:linear_operator_block_diag_test PASSED in 160.1s Stats over 8 runs: max = 160.1s, min = 127.3s, avg = 142.4s, dev = 11.6s //tensorflow/python/kernel_tests/linalg:linear_operator_block_lower_triangular_test PASSED in 135.3s Stats over 8 runs: max = 135.3s, min = 122.9s, avg = 129.9s, dev = 3.7s //tensorflow/python/kernel_tests/signal:fft_ops_test PASSED in 20.4s Stats over 8 runs: max = 20.4s, min = 6.3s, avg = 14.0s, dev = 4.9s //tensorflow/python/ops/ragged:ragged_shape_test PASSED in 111.9s Stats over 8 runs: max = 111.9s, min = 50.8s, avg = 71.9s, dev = 20.1s //tensorflow/compiler/tests:conv2d_test_cpu PASSED in 22.8s Stats over 10 runs: max = 22.8s, min = 4.5s, avg = 14.3s, dev = 6.5s //tensorflow/compiler/tests:conv2d_test_cpu_mlir_bridge_test PASSED in 42.0s Stats over 10 runs: max = 42.0s, min = 39.3s, avg = 40.9s, dev = 0.9s //tensorflow/compiler/tests:image_ops_test_cpu PASSED in 110.2s Stats over 10 runs: max = 110.2s, min = 89.9s, avg = 97.1s, dev = 6.0s //tensorflow/compiler/tests:image_ops_test_cpu_mlir_bridge_test PASSED in 79.3s Stats over 10 runs: max = 79.3s, min = 65.9s, avg = 73.5s, dev = 4.4s //tensorflow/compiler/tests:random_ops_test_cpu PASSED in 52.7s Stats over 10 runs: max = 52.7s, min = 43.9s, avg = 47.8s, dev = 2.9s //tensorflow/compiler/tests:random_ops_test_cpu_mlir_bridge_test PASSED in 18.9s Stats over 10 runs: max = 18.9s, min = 11.9s, avg = 15.1s, dev = 2.1s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 201.1s Stats over 10 runs: max = 201.1s, min = 95.2s, avg = 148.6s, dev = 31.5s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 125.6s Stats over 10 runs: max = 125.6s, min = 9.2s, avg = 77.0s, dev = 38.0s //tensorflow/compiler/xla/client/lib:svd_test_cpu PASSED in 111.4s Stats over 10 runs: max = 111.4s, min = 2.6s, avg = 31.0s, dev = 41.2s //tensorflow/compiler/xla/client/lib:tridiagonal_test_cpu PASSED in 9.4s Stats over 10 runs: max = 9.4s, min = 3.2s, avg = 5.0s, dev = 1.9s //tensorflow/compiler/xla/service/cpu:cpu_runtime_test PASSED in 6.1s Stats over 10 runs: max = 6.1s, min = 0.7s, avg = 4.7s, dev = 2.0s //tensorflow/python:special_math_ops_test PASSED in 141.8s Stats over 10 runs: max = 141.8s, min = 91.6s, avg = 101.2s, dev = 14.0s //tensorflow/python/data/kernel_tests:rejection_resample_test PASSED in 77.0s Stats over 10 runs: max = 77.0s, min = 56.9s, avg = 64.2s, dev = 6.2s //tensorflow/python/distribute:input_lib_test PASSED in 37.1s Stats over 10 runs: max = 37.1s, min = 19.5s, avg = 26.7s, dev = 5.5s //tensorflow/python/distribute:input_lib_type_spec_test PASSED in 53.7s Stats over 10 runs: max = 53.7s, min = 42.8s, avg = 48.3s, dev = 3.9s //tensorflow/python/framework:function_test PASSED in 86.8s Stats over 10 runs: max = 86.8s, min = 17.6s, avg = 28.0s, dev = 19.8s //tensorflow/python/grappler:cluster_test PASSED in 41.9s Stats over 10 runs: max = 41.9s, min = 40.3s, avg = 41.2s, dev = 0.4s //tensorflow/python/keras/mixed_precision:layer_correctness_test PASSED in 237.3s Stats over 10 runs: max = 237.3s, min = 204.0s, avg = 215.6s, dev = 9.8s //tensorflow/python/kernel_tests/array_ops:array_ops_test PASSED in 15.8s Stats over 10 runs: max = 15.8s, min = 4.8s, avg = 8.6s, dev = 3.8s //tensorflow/python/kernel_tests/array_ops:inplace_ops_test PASSED in 24.5s Stats over 10 runs: max = 24.5s, min = 15.7s, avg = 20.6s, dev = 2.3s //tensorflow/python/kernel_tests/data_structures:tensor_array_ops_test PASSED in 36.4s Stats over 10 runs: max = 36.4s, min = 28.2s, avg = 31.7s, dev = 2.5s //tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test PASSED in 278.7s Stats over 10 runs: max = 278.7s, min = 232.0s, avg = 256.0s, dev = 13.4s //tensorflow/python/kernel_tests/linalg:linear_operator_kronecker_test PASSED in 105.4s Stats over 10 runs: max = 105.4s, min = 88.1s, avg = 95.2s, dev = 5.5s //tensorflow/python/kernel_tests/linalg:linear_operator_low_rank_update_test PASSED in 149.4s Stats over 10 runs: max = 149.4s, min = 119.8s, avg = 136.6s, dev = 11.2s //tensorflow/python/kernel_tests/linalg:tridiagonal_matmul_op_test PASSED in 159.8s Stats over 10 runs: max = 159.8s, min = 76.3s, avg = 89.3s, dev = 23.7s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_ops_test PASSED in 107.2s Stats over 10 runs: max = 107.2s, min = 25.1s, avg = 44.2s, dev = 30.0s //tensorflow/python/kernel_tests/math_ops:segment_reduction_ops_test PASSED in 99.6s Stats over 10 runs: max = 99.6s, min = 25.9s, avg = 39.3s, dev = 22.2s //tensorflow/python/kernel_tests/nn_ops:pooling_ops_test PASSED in 45.4s Stats over 10 runs: max = 45.4s, min = 25.6s, avg = 34.8s, dev = 7.7s //tensorflow/python/kernel_tests/nn_ops:rnn_test PASSED in 93.4s Stats over 10 runs: max = 93.4s, min = 82.8s, avg = 86.6s, dev = 3.6s //tensorflow/python/kernel_tests/random:stateless_random_ops_test PASSED in 178.2s Stats over 10 runs: max = 178.2s, min = 148.2s, avg = 166.1s, dev = 9.7s //tensorflow/python/saved_model:load_test PASSED in 220.7s Stats over 10 runs: max = 220.7s, min = 158.6s, avg = 169.6s, dev = 17.2s //tensorflow/compiler/tests:fft_test_cpu PASSED in 81.0s Stats over 12 runs: max = 81.0s, min = 53.3s, avg = 70.5s, dev = 8.0s //tensorflow/python/data/experimental/kernel_tests:group_by_reducer_test PASSED in 105.6s Stats over 12 runs: max = 105.6s, min = 88.8s, avg = 95.9s, dev = 5.3s //tensorflow/python/data/kernel_tests:memory_cleanup_test PASSED in 43.0s Stats over 12 runs: max = 43.0s, min = 4.6s, avg = 33.0s, dev = 9.4s //tensorflow/python/distribute:multi_process_runner_test PASSED in 233.5s Stats over 12 runs: max = 233.5s, min = 22.7s, avg = 60.2s, dev = 58.2s //tensorflow/python/distribute:random_generator_test PASSED in 99.5s Stats over 12 runs: max = 99.5s, min = 56.8s, avg = 75.7s, dev = 10.3s //tensorflow/python/keras/layers:gru_v2_test PASSED in 149.6s Stats over 12 runs: max = 149.6s, min = 110.2s, avg = 122.2s, dev = 11.8s //tensorflow/python/keras/layers:recurrent_test PASSED in 118.3s Stats over 12 runs: max = 118.3s, min = 68.7s, avg = 88.9s, dev = 15.9s //tensorflow/python/kernel_tests/image_ops:extract_image_patches_grad_test PASSED in 265.0s Stats over 15 runs: max = 265.0s, min = 3.0s, avg = 43.9s, dev = 68.4s //tensorflow/python/kernel_tests/nn_ops:rnn_cell_test PASSED in 214.3s Stats over 15 runs: max = 214.3s, min = 155.4s, avg = 165.5s, dev = 14.9s //tensorflow/python:image_ops_test PASSED in 37.2s Stats over 16 runs: max = 37.2s, min = 8.4s, avg = 23.4s, dev = 7.2s //tensorflow/python/data/experimental/kernel_tests/service:coordinated_read_ft_test PASSED in 100.9s Stats over 16 runs: max = 100.9s, min = 41.5s, avg = 73.7s, dev = 19.3s //tensorflow/python/data/experimental/kernel_tests/service:coordinated_read_test PASSED in 35.0s Stats over 16 runs: max = 35.0s, min = 6.3s, avg = 14.4s, dev = 8.4s //tensorflow/python/data/experimental/kernel_tests/service:dynamic_sharding_test PASSED in 153.2s Stats over 16 runs: max = 153.2s, min = 137.6s, avg = 145.2s, dev = 4.4s //tensorflow/python/data/experimental/kernel_tests/service:worker_tags_test PASSED in 83.2s Stats over 16 runs: max = 83.2s, min = 33.9s, avg = 65.1s, dev = 11.4s //tensorflow/python/kernel_tests/control_flow:control_flow_ops_py_test PASSED in 72.7s Stats over 16 runs: max = 72.7s, min = 49.9s, avg = 54.5s, dev = 5.9s //tensorflow/python/kernel_tests/linalg:matrix_exponential_op_test PASSED in 30.2s Stats over 16 runs: max = 30.2s, min = 24.1s, avg = 27.0s, dev = 1.8s //tensorflow/python/kernel_tests/signal:dct_ops_test PASSED in 87.6s Stats over 16 runs: max = 87.6s, min = 77.6s, avg = 83.4s, dev = 2.8s //tensorflow/python/ops/parallel_for:control_flow_ops_test PASSED in 82.7s Stats over 16 runs: max = 82.7s, min = 33.5s, avg = 43.4s, dev = 11.7s //tensorflow/python/data/kernel_tests:snapshot_test FLAKY, failed in 1 out of 17 in 69.4s Stats over 17 runs: max = 69.4s, min = 21.7s, avg = 40.8s, dev = 14.4s /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/data/kernel_tests/snapshot_test/shard_6_of_16/test_attempts/attempt_1.log //tensorflow/python/data/kernel_tests:map_test PASSED in 45.1s Stats over 19 runs: max = 45.1s, min = 14.1s, avg = 27.5s, dev = 9.1s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 56.4s Stats over 20 runs: max = 56.4s, min = 39.5s, avg = 47.5s, dev = 4.4s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 36.7s Stats over 20 runs: max = 36.7s, min = 22.2s, avg = 28.8s, dev = 4.9s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 28.0s Stats over 20 runs: max = 28.0s, min = 4.3s, avg = 9.3s, dev = 5.5s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 57.7s Stats over 20 runs: max = 57.7s, min = 33.8s, avg = 40.3s, dev = 6.5s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 3.9s Stats over 20 runs: max = 3.9s, min = 2.5s, avg = 3.0s, dev = 0.3s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 11.7s Stats over 20 runs: max = 11.7s, min = 7.5s, avg = 9.5s, dev = 1.3s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 13.9s Stats over 20 runs: max = 13.9s, min = 7.5s, avg = 9.9s, dev = 2.0s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 214.9s Stats over 20 runs: max = 214.9s, min = 5.4s, avg = 35.5s, dev = 46.2s //tensorflow/python/kernel_tests:metrics_test PASSED in 85.9s Stats over 20 runs: max = 85.9s, min = 47.0s, avg = 61.6s, dev = 9.2s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test PASSED in 71.3s Stats over 20 runs: max = 71.3s, min = 48.3s, avg = 62.3s, dev = 7.8s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 15.7s Stats over 20 runs: max = 15.7s, min = 4.2s, avg = 10.3s, dev = 3.6s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 74.2s Stats over 20 runs: max = 74.2s, min = 46.9s, avg = 56.1s, dev = 7.9s //tensorflow/python/kernel_tests/linalg:linalg_grad_test PASSED in 76.4s Stats over 20 runs: max = 76.4s, min = 25.2s, avg = 44.5s, dev = 14.0s //tensorflow/python/kernel_tests/linalg:norm_op_test PASSED in 52.8s Stats over 20 runs: max = 52.8s, min = 22.0s, avg = 34.4s, dev = 8.7s //tensorflow/python/kernel_tests/linalg:normalize_op_test PASSED in 27.8s Stats over 20 runs: max = 27.8s, min = 14.2s, avg = 21.2s, dev = 4.6s //tensorflow/python/kernel_tests/linalg:qr_op_test PASSED in 163.3s Stats over 20 runs: max = 163.3s, min = 66.3s, avg = 117.1s, dev = 34.6s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test PASSED in 22.9s Stats over 20 runs: max = 22.9s, min = 9.1s, avg = 14.0s, dev = 3.3s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test PASSED in 90.7s Stats over 20 runs: max = 90.7s, min = 74.5s, avg = 82.0s, dev = 5.0s //tensorflow/python/kernel_tests/math_ops:matmul_op_test PASSED in 25.5s Stats over 20 runs: max = 25.5s, min = 13.8s, avg = 18.4s, dev = 2.9s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test PASSED in 115.8s Stats over 20 runs: max = 115.8s, min = 61.6s, avg = 82.7s, dev = 17.9s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test PASSED in 79.6s Stats over 20 runs: max = 79.6s, min = 62.7s, avg = 71.7s, dev = 4.7s //tensorflow/python:nn_fused_batchnorm_test PASSED in 297.9s Stats over 24 runs: max = 297.9s, min = 14.5s, avg = 56.0s, dev = 71.8s //tensorflow/python/data/experimental/kernel_tests:directed_interleave_dataset_test PASSED in 78.6s Stats over 24 runs: max = 78.6s, min = 56.9s, avg = 66.7s, dev = 6.3s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 97.5s Stats over 24 runs: max = 97.5s, min = 39.1s, avg = 79.2s, dev = 10.5s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 79.1s Stats over 24 runs: max = 79.1s, min = 16.1s, avg = 34.9s, dev = 19.4s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 5.2s Stats over 25 runs: max = 5.2s, min = 2.6s, avg = 3.8s, dev = 0.8s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 10.7s Stats over 30 runs: max = 10.7s, min = 3.6s, avg = 5.6s, dev = 1.9s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 18.9s Stats over 30 runs: max = 18.9s, min = 13.8s, avg = 15.8s, dev = 1.2s //tensorflow/compiler/xla/tests:local_client_execute_test_cpu PASSED in 93.4s Stats over 30 runs: max = 93.4s, min = 3.8s, avg = 7.7s, dev = 15.9s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 3.8s Stats over 30 runs: max = 3.8s, min = 2.6s, avg = 3.1s, dev = 0.3s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 3.7s Stats over 30 runs: max = 3.7s, min = 2.6s, avg = 3.0s, dev = 0.3s //tensorflow/python/keras/engine:training_integration_test PASSED in 106.0s Stats over 30 runs: max = 106.0s, min = 13.1s, avg = 51.9s, dev = 28.5s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test PASSED in 33.6s Stats over 30 runs: max = 33.6s, min = 3.2s, avg = 15.3s, dev = 8.5s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 11.7s Stats over 31 runs: max = 11.7s, min = 4.7s, avg = 7.4s, dev = 1.7s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 6.4s Stats over 32 runs: max = 6.4s, min = 2.9s, avg = 4.1s, dev = 0.9s //tensorflow/python/data/experimental/kernel_tests/service:auto_shard_test PASSED in 117.1s Stats over 32 runs: max = 117.1s, min = 5.5s, avg = 95.3s, dev = 18.4s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 95.8s Stats over 32 runs: max = 95.8s, min = 11.2s, avg = 29.6s, dev = 23.7s //tensorflow/python/distribute/coordinator:cluster_coordinator_test NO STATUS in 43.4s Stats over 33 runs: max = 43.4s, min = 21.1s, avg = 36.2s, dev = 5.6s //tensorflow/python/distribute/coordinator:fault_tolerance_test PASSED in 116.9s Stats over 36 runs: max = 116.9s, min = 71.2s, avg = 95.1s, dev = 10.3s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 15.2s Stats over 40 runs: max = 15.2s, min = 4.6s, avg = 7.8s, dev = 2.8s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 4.6s Stats over 40 runs: max = 4.6s, min = 3.5s, avg = 3.9s, dev = 0.3s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 12.0s Stats over 40 runs: max = 12.0s, min = 4.7s, avg = 7.2s, dev = 2.0s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 11.3s Stats over 40 runs: max = 11.3s, min = 3.2s, avg = 6.0s, dev = 2.1s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 7.3s Stats over 50 runs: max = 7.3s, min = 3.7s, avg = 4.6s, dev = 0.7s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 4.9s Stats over 50 runs: max = 4.9s, min = 3.7s, avg = 4.0s, dev = 0.2s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 16.3s Stats over 50 runs: max = 16.3s, min = 4.3s, avg = 7.7s, dev = 2.5s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test PASSED in 41.4s Stats over 50 runs: max = 41.4s, min = 5.1s, avg = 18.4s, dev = 10.7s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test PASSED in 204.2s Stats over 50 runs: max = 204.2s, min = 75.1s, avg = 161.8s, dev = 43.4s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test PASSED in 36.5s Stats over 50 runs: max = 36.5s, min = 2.8s, avg = 17.7s, dev = 12.3s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test PASSED in 61.7s Stats over 50 runs: max = 61.7s, min = 9.2s, avg = 28.5s, dev = 13.3s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test PASSED in 30.5s Stats over 50 runs: max = 30.5s, min = 3.7s, avg = 14.0s, dev = 7.0s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test PASSED in 46.7s Stats over 50 runs: max = 46.7s, min = 3.3s, avg = 22.3s, dev = 13.2s

Executed 3125 out of 3148 tests: 3123 tests pass, 1 fails to build and 24 were skipped. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted>

PLAY RECAP ********************************************************************* localhost : ok=44 changed=27 unreachable=0 failed=1 skipped=9 rescued=0 ignored=0

Tuesday 11 January 2022 21:27:49 +0000 (2:25:10.432) 3:16:52.719 ******* =============================================================================== tensorflow : Run unit tests on TensorFlow git for cp37-cp37m --------- 8710.43s tensorflow : build TensorFlow git for cp37-cp37m --------------------- 1964.48s python : build wheels of Python package h5py~=3.1.0 ------------------- 550.73s python : build wheels of Python package Keras_Applications ------------ 281.09s install bazel build requirements --------------------------------------- 50.42s tensorflow : populate cp37-cp37m virtualenv ---------------------------- 41.36s fetch tensorflow from git ---------------------------------------------- 39.58s python : create cp37-cp37m virtualenv ---------------------------------- 33.99s python : install numpy build requirements ------------------------------ 30.08s bazel : fetch Bazel 3.7.2 binary from Github --------------------------- 15.19s python : install h5py build requirements ------------------------------- 13.70s python : build wheels of Python package grpcio -------------------------- 9.53s install tensorflow build requirements ----------------------------------- 9.11s python : build wheels of Python package scipy --------------------------- 8.02s python : install scipy-1.5.4-cp37-cp37m-manylinux2014_aarch64.whl Python package --- 7.85s tensorflow : remove TensorFlow git sources from previous build ---------- 5.71s python : build wheels of Python package numpy>=1.20 --------------------- 5.19s python : build wheels of Python package Keras_Preprocessing ------------- 5.14s Gathering Facts --------------------------------------------------------- 4.98s python : install h5py-3.1.0-cp37-cp37m-linux_aarch64.whl Python package --- 4.10s Build step 'Execute shell' marked build as failure