See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/204/display/redirect
Changes:
------------------------------------------ [...truncated 108.78 MB...] Stats over 6 runs: max = 10.7s, min = 8.8s, avg = 9.6s, dev = 0.7s //tensorflow/python/kernel_tests/array_ops:diag_op_test PASSED in 85.4s Stats over 6 runs: max = 85.4s, min = 6.7s, avg = 23.2s, dev = 28.0s //tensorflow/python/kernel_tests/math_ops:reduction_ops_test PASSED in 34.4s Stats over 6 runs: max = 34.4s, min = 25.1s, avg = 30.1s, dev = 3.2s //tensorflow/python/distribute/experimental/rpc:rpc_ops_test PASSED in 11.8s Stats over 7 runs: max = 11.8s, min = 7.3s, avg = 9.5s, dev = 1.5s //tensorflow/compiler/tests:matrix_diag_ops_test_cpu PASSED in 65.0s Stats over 8 runs: max = 65.0s, min = 6.4s, avg = 25.7s, dev = 20.1s //tensorflow/compiler/tests:matrix_diag_ops_test_cpu_mlir_bridge_test PASSED in 73.9s Stats over 8 runs: max = 73.9s, min = 7.3s, avg = 28.2s, dev = 22.5s //tensorflow/python/data/experimental/kernel_tests:csv_dataset_test PASSED in 33.5s Stats over 8 runs: max = 33.5s, min = 7.2s, avg = 16.1s, dev = 8.2s //tensorflow/python/data/experimental/kernel_tests:parallel_interleave_test PASSED in 31.4s Stats over 8 runs: max = 31.4s, min = 8.6s, avg = 18.6s, dev = 7.6s //tensorflow/python/data/kernel_tests:flat_map_test PASSED in 29.0s Stats over 8 runs: max = 29.0s, min = 15.0s, avg = 21.2s, dev = 4.7s //tensorflow/python/data/kernel_tests:tf_record_dataset_test PASSED in 31.6s Stats over 8 runs: max = 31.6s, min = 15.4s, avg = 21.9s, dev = 4.9s //tensorflow/python/keras:models_test PASSED in 30.9s Stats over 8 runs: max = 30.9s, min = 11.8s, avg = 21.2s, dev = 6.7s //tensorflow/python/keras:optimizers_test PASSED in 10.1s Stats over 8 runs: max = 10.1s, min = 9.1s, avg = 9.6s, dev = 0.4s //tensorflow/python/keras/engine:base_layer_test PASSED in 21.9s Stats over 8 runs: max = 21.9s, min = 13.1s, avg = 17.7s, dev = 2.9s //tensorflow/python/keras/engine:control_flow_test PASSED in 53.0s Stats over 8 runs: max = 53.0s, min = 46.6s, avg = 49.6s, dev = 2.3s //tensorflow/python/keras/engine:functional_test PASSED in 29.8s Stats over 8 runs: max = 29.8s, min = 9.9s, avg = 19.5s, dev = 6.2s //tensorflow/python/keras/layers:convolutional_recurrent_test PASSED in 39.7s Stats over 8 runs: max = 39.7s, min = 12.3s, avg = 24.6s, dev = 8.5s //tensorflow/python/keras/layers:convolutional_test PASSED in 61.0s Stats over 8 runs: max = 61.0s, min = 31.2s, avg = 46.2s, dev = 8.1s //tensorflow/python/keras/layers:pooling_test PASSED in 27.1s Stats over 8 runs: max = 27.1s, min = 12.3s, avg = 20.0s, dev = 4.3s //tensorflow/python/keras/optimizer_v2:optimizer_v2_test PASSED in 115.9s Stats over 8 runs: max = 115.9s, min = 73.5s, avg = 97.6s, dev = 15.9s //tensorflow/python/keras/utils:composite_tensor_support_test PASSED in 37.1s Stats over 8 runs: max = 37.1s, min = 21.1s, avg = 28.6s, dev = 5.5s //tensorflow/python/kernel_tests/linalg:linalg_ops_test PASSED in 74.7s Stats over 8 runs: max = 74.7s, min = 46.5s, avg = 60.8s, dev = 10.4s //tensorflow/python/kernel_tests/linalg:linear_operator_block_diag_test PASSED in 127.2s Stats over 8 runs: max = 127.2s, min = 89.4s, avg = 105.1s, dev = 13.1s //tensorflow/python/kernel_tests/linalg:linear_operator_block_lower_triangular_test PASSED in 88.6s Stats over 8 runs: max = 88.6s, min = 78.4s, avg = 82.6s, dev = 2.9s //tensorflow/python/kernel_tests/signal:fft_ops_test PASSED in 79.6s Stats over 8 runs: max = 79.6s, min = 12.1s, avg = 27.9s, dev = 23.7s //tensorflow/python/ops/ragged:ragged_shape_test PASSED in 127.5s Stats over 8 runs: max = 127.5s, min = 70.4s, avg = 90.2s, dev = 18.9s //tensorflow/compiler/tests:conv2d_test_cpu PASSED in 8.6s Stats over 10 runs: max = 8.6s, min = 3.6s, avg = 5.3s, dev = 1.7s //tensorflow/compiler/tests:conv2d_test_cpu_mlir_bridge_test PASSED in 8.7s Stats over 10 runs: max = 8.7s, min = 4.1s, avg = 6.0s, dev = 1.8s //tensorflow/compiler/tests:image_ops_test_cpu PASSED in 23.6s Stats over 10 runs: max = 23.6s, min = 12.6s, avg = 17.1s, dev = 3.4s //tensorflow/compiler/tests:image_ops_test_cpu_mlir_bridge_test PASSED in 25.2s Stats over 10 runs: max = 25.2s, min = 17.9s, avg = 21.7s, dev = 3.0s //tensorflow/compiler/tests:random_ops_test_cpu PASSED in 13.7s Stats over 10 runs: max = 13.7s, min = 4.4s, avg = 8.9s, dev = 3.0s //tensorflow/compiler/tests:random_ops_test_cpu_mlir_bridge_test PASSED in 14.1s Stats over 10 runs: max = 14.1s, min = 4.9s, avg = 9.1s, dev = 3.0s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 79.3s Stats over 10 runs: max = 79.3s, min = 6.0s, avg = 41.1s, dev = 22.0s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 75.9s Stats over 10 runs: max = 75.9s, min = 5.6s, avg = 38.7s, dev = 19.9s //tensorflow/compiler/xla/client/lib:svd_test_cpu PASSED in 125.8s Stats over 10 runs: max = 125.8s, min = 2.6s, avg = 34.1s, dev = 46.7s //tensorflow/compiler/xla/client/lib:tridiagonal_test_cpu PASSED in 3.4s Stats over 10 runs: max = 3.4s, min = 2.6s, avg = 3.1s, dev = 0.3s //tensorflow/python:special_math_ops_test PASSED in 46.0s Stats over 10 runs: max = 46.0s, min = 7.2s, avg = 15.1s, dev = 10.7s //tensorflow/python/data/kernel_tests:rejection_resample_test PASSED in 16.2s Stats over 10 runs: max = 16.2s, min = 3.2s, avg = 8.6s, dev = 3.6s //tensorflow/python/distribute:input_lib_test PASSED in 51.5s Stats over 10 runs: max = 51.5s, min = 38.4s, avg = 43.8s, dev = 3.5s //tensorflow/python/distribute:input_lib_type_spec_test PASSED in 24.3s Stats over 10 runs: max = 24.3s, min = 11.8s, avg = 17.5s, dev = 4.2s //tensorflow/python/framework:function_test PASSED in 65.7s Stats over 10 runs: max = 65.7s, min = 7.0s, avg = 15.8s, dev = 16.9s //tensorflow/python/grappler:cluster_test PASSED in 9.3s Stats over 10 runs: max = 9.3s, min = 8.3s, avg = 8.8s, dev = 0.3s //tensorflow/python/keras/mixed_precision:layer_correctness_test PASSED in 99.3s Stats over 10 runs: max = 99.3s, min = 52.8s, avg = 71.6s, dev = 14.8s //tensorflow/python/kernel_tests/array_ops:array_ops_test PASSED in 11.9s Stats over 10 runs: max = 11.9s, min = 6.0s, avg = 8.8s, dev = 1.8s //tensorflow/python/kernel_tests/array_ops:inplace_ops_test PASSED in 6.4s Stats over 10 runs: max = 6.4s, min = 3.2s, avg = 4.1s, dev = 1.0s //tensorflow/python/kernel_tests/data_structures:tensor_array_ops_test PASSED in 9.1s Stats over 10 runs: max = 9.1s, min = 3.8s, avg = 6.7s, dev = 1.7s //tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test PASSED in 170.1s Stats over 10 runs: max = 170.1s, min = 129.8s, avg = 147.9s, dev = 15.7s //tensorflow/python/kernel_tests/linalg:linear_operator_kronecker_test PASSED in 102.6s Stats over 10 runs: max = 102.6s, min = 81.2s, avg = 92.0s, dev = 7.8s //tensorflow/python/kernel_tests/linalg:linear_operator_low_rank_update_test PASSED in 174.9s Stats over 10 runs: max = 174.9s, min = 134.7s, avg = 155.1s, dev = 17.3s //tensorflow/python/kernel_tests/linalg:tridiagonal_matmul_op_test PASSED in 76.3s Stats over 10 runs: max = 76.3s, min = 4.4s, avg = 13.7s, dev = 20.9s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_ops_test PASSED in 419.8s Stats over 10 runs: max = 419.8s, min = 3.9s, avg = 94.0s, dev = 162.2s //tensorflow/python/kernel_tests/math_ops:segment_reduction_ops_test PASSED in 78.4s Stats over 10 runs: max = 78.4s, min = 10.7s, avg = 20.8s, dev = 20.3s //tensorflow/python/kernel_tests/nn_ops:pooling_ops_test PASSED in 39.0s Stats over 10 runs: max = 39.0s, min = 9.3s, avg = 21.5s, dev = 12.5s //tensorflow/python/kernel_tests/nn_ops:rnn_test PASSED in 10.2s Stats over 10 runs: max = 10.2s, min = 5.9s, avg = 8.0s, dev = 1.5s //tensorflow/python/kernel_tests/random:stateless_random_ops_test PASSED in 105.4s Stats over 10 runs: max = 105.4s, min = 84.0s, avg = 93.6s, dev = 7.9s //tensorflow/python/saved_model:load_test PASSED in 89.7s Stats over 10 runs: max = 89.7s, min = 39.9s, avg = 50.4s, dev = 14.1s //tensorflow/compiler/tests:fft_test_cpu PASSED in 31.6s Stats over 12 runs: max = 31.6s, min = 10.0s, avg = 21.4s, dev = 7.3s //tensorflow/python/data/experimental/kernel_tests:group_by_reducer_test PASSED in 21.1s Stats over 12 runs: max = 21.1s, min = 6.4s, avg = 11.9s, dev = 4.9s //tensorflow/python/data/kernel_tests:memory_cleanup_test PASSED in 23.9s Stats over 12 runs: max = 23.9s, min = 10.1s, avg = 16.1s, dev = 3.6s //tensorflow/python/distribute:multi_process_runner_test PASSED in 224.5s Stats over 12 runs: max = 224.5s, min = 12.3s, avg = 50.6s, dev = 58.3s //tensorflow/python/distribute:random_generator_test PASSED in 76.1s Stats over 12 runs: max = 76.1s, min = 28.1s, avg = 46.8s, dev = 11.5s //tensorflow/python/keras/layers:gru_v2_test PASSED in 84.2s Stats over 12 runs: max = 84.2s, min = 34.6s, avg = 50.5s, dev = 16.1s //tensorflow/python/keras/layers:recurrent_test PASSED in 103.7s Stats over 12 runs: max = 103.7s, min = 34.9s, avg = 64.2s, dev = 22.6s //tensorflow/python/kernel_tests/image_ops:extract_image_patches_grad_test PASSED in 254.7s Stats over 15 runs: max = 254.7s, min = 3.4s, avg = 38.4s, dev = 64.3s //tensorflow/python/kernel_tests/nn_ops:rnn_cell_test PASSED in 61.5s Stats over 15 runs: max = 61.5s, min = 9.5s, avg = 16.3s, dev = 12.9s //tensorflow/python:image_ops_test PASSED in 27.5s Stats over 16 runs: max = 27.5s, min = 6.8s, avg = 14.3s, dev = 4.7s //tensorflow/python/data/experimental/kernel_tests/service:coordinated_read_ft_test PASSED in 42.7s Stats over 16 runs: max = 42.7s, min = 11.7s, avg = 19.2s, dev = 11.0s //tensorflow/python/data/experimental/kernel_tests/service:coordinated_read_test PASSED in 29.2s Stats over 16 runs: max = 29.2s, min = 7.3s, avg = 14.3s, dev = 6.0s //tensorflow/python/data/experimental/kernel_tests/service:dynamic_sharding_test PASSED in 21.4s Stats over 16 runs: max = 21.4s, min = 10.4s, avg = 15.8s, dev = 3.3s //tensorflow/python/data/experimental/kernel_tests/service:worker_tags_test PASSED in 19.5s Stats over 16 runs: max = 19.5s, min = 4.1s, avg = 11.8s, dev = 5.0s //tensorflow/python/data/kernel_tests:snapshot_test PASSED in 29.4s Stats over 16 runs: max = 29.4s, min = 8.9s, avg = 18.4s, dev = 4.7s //tensorflow/python/kernel_tests/control_flow:control_flow_ops_py_test PASSED in 36.7s Stats over 16 runs: max = 36.7s, min = 7.7s, avg = 16.7s, dev = 7.7s //tensorflow/python/kernel_tests/linalg:matrix_exponential_op_test PASSED in 10.2s Stats over 16 runs: max = 10.2s, min = 3.7s, avg = 6.0s, dev = 2.2s //tensorflow/python/kernel_tests/signal:dct_ops_test PASSED in 11.5s Stats over 16 runs: max = 11.5s, min = 7.1s, avg = 9.4s, dev = 1.4s //tensorflow/python/ops/parallel_for:control_flow_ops_test PASSED in 84.2s Stats over 16 runs: max = 84.2s, min = 7.5s, avg = 22.6s, dev = 17.0s //tensorflow/python/data/kernel_tests:map_test PASSED in 28.9s Stats over 19 runs: max = 28.9s, min = 11.0s, avg = 20.0s, dev = 5.4s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 7.9s Stats over 20 runs: max = 7.9s, min = 3.3s, avg = 4.9s, dev = 1.4s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 8.6s Stats over 20 runs: max = 8.6s, min = 3.8s, avg = 5.6s, dev = 1.4s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 12.5s Stats over 20 runs: max = 12.5s, min = 3.0s, avg = 5.9s, dev = 2.5s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 13.1s Stats over 20 runs: max = 13.1s, min = 4.3s, avg = 6.8s, dev = 2.0s //tensorflow/python/kernel_tests:metrics_test PASSED in 49.8s Stats over 20 runs: max = 49.8s, min = 9.4s, avg = 21.8s, dev = 12.1s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test PASSED in 7.8s Stats over 20 runs: max = 7.8s, min = 3.2s, avg = 4.8s, dev = 1.5s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 12.9s Stats over 20 runs: max = 12.9s, min = 3.9s, avg = 7.3s, dev = 2.2s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 28.1s Stats over 20 runs: max = 28.1s, min = 5.5s, avg = 12.0s, dev = 7.1s //tensorflow/python/kernel_tests/linalg:linalg_grad_test PASSED in 62.4s Stats over 20 runs: max = 62.4s, min = 26.0s, avg = 39.0s, dev = 11.2s //tensorflow/python/kernel_tests/linalg:norm_op_test PASSED in 8.3s Stats over 20 runs: max = 8.3s, min = 3.8s, avg = 6.0s, dev = 1.4s //tensorflow/python/kernel_tests/linalg:normalize_op_test PASSED in 13.0s Stats over 20 runs: max = 13.0s, min = 5.8s, avg = 9.5s, dev = 2.3s //tensorflow/python/kernel_tests/linalg:qr_op_test PASSED in 135.3s Stats over 20 runs: max = 135.3s, min = 29.6s, avg = 83.1s, dev = 35.8s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test PASSED in 16.0s Stats over 20 runs: max = 16.0s, min = 3.5s, avg = 8.3s, dev = 3.8s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test PASSED in 17.9s Stats over 20 runs: max = 17.9s, min = 5.0s, avg = 11.1s, dev = 4.5s //tensorflow/python/kernel_tests/math_ops:matmul_op_test PASSED in 50.4s Stats over 20 runs: max = 50.4s, min = 13.8s, avg = 29.2s, dev = 14.6s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test PASSED in 65.2s Stats over 20 runs: max = 65.2s, min = 5.4s, avg = 28.4s, dev = 20.6s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test PASSED in 24.2s Stats over 20 runs: max = 24.2s, min = 3.8s, avg = 8.4s, dev = 4.4s //tensorflow/python:nn_fused_batchnorm_test PASSED in 174.3s Stats over 24 runs: max = 174.3s, min = 3.5s, avg = 24.3s, dev = 43.8s //tensorflow/python/data/experimental/kernel_tests:directed_interleave_dataset_test PASSED in 22.9s Stats over 24 runs: max = 22.9s, min = 3.6s, avg = 9.1s, dev = 5.5s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 20.5s Stats over 24 runs: max = 20.5s, min = 9.1s, avg = 14.6s, dev = 2.9s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 23.1s Stats over 24 runs: max = 23.1s, min = 7.0s, avg = 13.2s, dev = 3.8s //tensorflow/python/keras/engine:training_integration_test PASSED in 37.6s Stats over 30 runs: max = 37.6s, min = 11.4s, avg = 22.7s, dev = 9.5s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test PASSED in 21.3s Stats over 30 runs: max = 21.3s, min = 3.6s, avg = 10.1s, dev = 3.9s //tensorflow/python/data/experimental/kernel_tests/service:auto_shard_test PASSED in 19.8s Stats over 32 runs: max = 19.8s, min = 4.2s, avg = 12.7s, dev = 4.1s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 23.3s Stats over 32 runs: max = 23.3s, min = 8.1s, avg = 15.0s, dev = 4.2s //tensorflow/python/distribute/coordinator:fault_tolerance_test FLAKY, failed in 3 out of 39 in 500.2s Stats over 39 runs: max = 500.2s, min = 5.1s, avg = 44.0s, dev = 106.2s /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/distribute/coordinator/fault_tolerance_test/shard_9_of_36/test_attempts/attempt_1.log /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/distribute/coordinator/fault_tolerance_test/shard_17_of_36/test_attempts/attempt_1.log /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/distribute/coordinator/fault_tolerance_test/shard_10_of_36/test_attempts/attempt_1.log //tensorflow/python/distribute/coordinator:cluster_coordinator_test PASSED in 46.7s Stats over 50 runs: max = 46.7s, min = 5.6s, avg = 10.5s, dev = 5.9s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test PASSED in 12.2s Stats over 50 runs: max = 12.2s, min = 4.8s, avg = 8.0s, dev = 2.4s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test PASSED in 9.9s Stats over 50 runs: max = 9.9s, min = 3.3s, avg = 4.8s, dev = 1.7s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test PASSED in 9.8s Stats over 50 runs: max = 9.8s, min = 3.3s, avg = 4.5s, dev = 1.7s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test PASSED in 34.8s Stats over 50 runs: max = 34.8s, min = 8.2s, avg = 16.4s, dev = 7.3s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test PASSED in 14.5s Stats over 50 runs: max = 14.5s, min = 3.1s, avg = 4.5s, dev = 1.7s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test PASSED in 12.2s Stats over 50 runs: max = 12.2s, min = 3.3s, avg = 5.0s, dev = 2.0s
Executed 2896 out of 2896 tests: 2894 tests pass and 2 fail locally. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=44 changed=27 unreachable=0 failed=1 skipped=9 rescued=0 ignored=0
Thursday 16 December 2021 20:10:09 +0000 (1:16:11.627) 1:59:34.576 ***** =============================================================================== tensorflow : Run unit tests on TensorFlow git for cp36-cp36m --------- 4571.63s tensorflow : build TensorFlow git for cp36-cp36m --------------------- 1667.54s python : build wheels of Python package h5py~=3.1.0 ------------------- 425.44s python : build wheels of Python package Keras_Applications ------------ 250.39s install bazel build requirements --------------------------------------- 47.05s tensorflow : populate cp36-cp36m virtualenv ---------------------------- 37.21s python : install numpy build requirements ------------------------------ 32.85s fetch tensorflow from git ---------------------------------------------- 21.94s python : install h5py build requirements ------------------------------- 16.85s python : create cp36-cp36m virtualenv ---------------------------------- 15.89s bazel : fetch Bazel 3.7.2 binary from Github --------------------------- 15.19s python : build wheels of Python package grpcio -------------------------- 9.36s install tensorflow build requirements ----------------------------------- 8.73s python : install scipy-1.5.4-cp36-cp36m-manylinux2014_aarch64.whl Python package --- 6.57s python : build wheels of Python package scipy --------------------------- 6.48s python : build wheels of Python package Keras_Preprocessing ------------- 6.00s Gathering Facts --------------------------------------------------------- 4.55s python : build wheels of Python package numpy~=1.19.5 ------------------- 4.42s tensorflow : remove TensorFlow git sources from previous build ---------- 4.37s python : enable EPEL ---------------------------------------------------- 3.02s Build step 'Execute shell' marked build as failure