See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/174/display/redirect
Changes:
------------------------------------------ [...truncated 76.41 MB...] //tensorflow/python/kernel_tests/nn_ops:conv_ops_test PASSED in 29.4s Stats over 4 runs: max = 29.4s, min = 19.3s, avg = 23.9s, dev = 4.2s //tensorflow/python/kernel_tests/signal:window_ops_test PASSED in 16.4s Stats over 4 runs: max = 16.4s, min = 15.9s, avg = 16.2s, dev = 0.2s //tensorflow/python/ops/ragged:ragged_getitem_test PASSED in 50.6s Stats over 4 runs: max = 50.6s, min = 45.9s, avg = 47.6s, dev = 1.8s //tensorflow/compiler/tests:async_comp_test PASSED in 11.7s Stats over 5 runs: max = 11.7s, min = 10.2s, avg = 11.0s, dev = 0.6s //tensorflow/compiler/tests:conv3d_test_cpu PASSED in 21.9s Stats over 5 runs: max = 21.9s, min = 8.1s, avg = 13.1s, dev = 5.4s //tensorflow/compiler/tests:conv3d_test_cpu_mlir_bridge_test PASSED in 23.7s Stats over 5 runs: max = 23.7s, min = 4.4s, avg = 12.0s, dev = 6.9s //tensorflow/compiler/tests:depthwise_conv_op_test_cpu PASSED in 33.7s Stats over 5 runs: max = 33.7s, min = 10.6s, avg = 22.2s, dev = 8.2s //tensorflow/compiler/tests:depthwise_conv_op_test_cpu_mlir_bridge_test PASSED in 32.7s Stats over 5 runs: max = 32.7s, min = 12.0s, avg = 22.7s, dev = 7.3s //tensorflow/compiler/tests:fused_batchnorm_test_cpu PASSED in 10.2s Stats over 5 runs: max = 10.2s, min = 7.9s, avg = 9.2s, dev = 0.8s //tensorflow/compiler/tests:reduce_ops_test_cpu PASSED in 14.3s Stats over 5 runs: max = 14.3s, min = 12.5s, avg = 13.6s, dev = 0.6s //tensorflow/compiler/tests:reduce_ops_test_cpu_mlir_bridge_test PASSED in 18.6s Stats over 5 runs: max = 18.6s, min = 14.8s, avg = 16.8s, dev = 1.2s //tensorflow/compiler/tests:special_math_test_cpu PASSED in 160.9s Stats over 5 runs: max = 160.9s, min = 26.9s, avg = 76.7s, dev = 45.8s //tensorflow/compiler/tests:special_math_test_cpu_mlir_bridge_test PASSED in 159.9s Stats over 5 runs: max = 159.9s, min = 21.9s, avg = 73.1s, dev = 47.3s //tensorflow/compiler/xla/client/lib:self_adjoint_eig_test_cpu PASSED in 29.9s Stats over 5 runs: max = 29.9s, min = 14.4s, avg = 23.8s, dev = 6.8s //tensorflow/core/grappler/optimizers:constant_folding_test PASSED in 1.8s Stats over 5 runs: max = 1.8s, min = 0.9s, avg = 1.4s, dev = 0.3s //tensorflow/python/distribute:custom_training_loop_input_test PASSED in 16.2s Stats over 5 runs: max = 16.2s, min = 9.5s, avg = 12.3s, dev = 3.0s //tensorflow/python/distribute:vars_test PASSED in 20.9s Stats over 5 runs: max = 20.9s, min = 8.1s, avg = 14.4s, dev = 5.1s //tensorflow/python/eager:device_placement_test PASSED in 9.0s Stats over 5 runs: max = 9.0s, min = 8.3s, avg = 8.8s, dev = 0.3s //tensorflow/python/eager:forwardprop_test PASSED in 138.7s Stats over 5 runs: max = 138.7s, min = 55.1s, avg = 89.9s, dev = 34.7s //tensorflow/python/kernel_tests/linalg:linear_operator_adjoint_test PASSED in 81.8s Stats over 5 runs: max = 81.8s, min = 74.3s, avg = 77.4s, dev = 2.7s //tensorflow/python/kernel_tests/linalg:linear_operator_diag_test PASSED in 71.7s Stats over 5 runs: max = 71.7s, min = 64.1s, avg = 67.8s, dev = 2.4s //tensorflow/python/kernel_tests/linalg:linear_operator_full_matrix_test PASSED in 59.4s Stats over 5 runs: max = 59.4s, min = 55.0s, avg = 57.8s, dev = 1.5s //tensorflow/python/kernel_tests/linalg:linear_operator_householder_test PASSED in 42.6s Stats over 5 runs: max = 42.6s, min = 41.6s, avg = 42.1s, dev = 0.4s //tensorflow/python/kernel_tests/linalg:linear_operator_identity_test PASSED in 90.8s Stats over 5 runs: max = 90.8s, min = 81.1s, avg = 86.4s, dev = 3.2s //tensorflow/python/kernel_tests/linalg:linear_operator_inversion_test PASSED in 79.9s Stats over 5 runs: max = 79.9s, min = 68.9s, avg = 72.7s, dev = 3.7s //tensorflow/python/kernel_tests/linalg:linear_operator_permutation_test PASSED in 43.2s Stats over 5 runs: max = 43.2s, min = 42.4s, avg = 42.8s, dev = 0.4s //tensorflow/python/kernel_tests/linalg:linear_operator_toeplitz_test PASSED in 57.2s Stats over 5 runs: max = 57.2s, min = 53.9s, avg = 55.7s, dev = 1.1s //tensorflow/python/kernel_tests/linalg:linear_operator_zeros_test PASSED in 39.5s Stats over 5 runs: max = 39.5s, min = 38.0s, avg = 38.6s, dev = 0.6s //tensorflow/python/kernel_tests/sparse_ops:sparse_ops_test PASSED in 35.9s Stats over 5 runs: max = 35.9s, min = 6.6s, avg = 13.5s, dev = 11.2s //tensorflow/python/ops/parallel_for:math_test PASSED in 100.3s Stats over 5 runs: max = 100.3s, min = 30.7s, avg = 58.4s, dev = 25.3s //tensorflow/python:accumulate_n_benchmark PASSED in 7.5s Stats over 6 runs: max = 7.5s, min = 6.1s, avg = 6.8s, dev = 0.6s //tensorflow/python/keras/engine:training_generator_test PASSED in 42.0s Stats over 6 runs: max = 42.0s, min = 35.3s, avg = 39.2s, dev = 2.3s //tensorflow/python/keras/utils:data_utils_test PASSED in 10.5s Stats over 6 runs: max = 10.5s, min = 5.9s, avg = 9.2s, dev = 1.6s //tensorflow/python/kernel_tests/math_ops:reduction_ops_test PASSED in 36.1s Stats over 6 runs: max = 36.1s, min = 26.6s, avg = 32.4s, dev = 2.9s //tensorflow/python/distribute/experimental/rpc:rpc_ops_test PASSED in 13.9s Stats over 7 runs: max = 13.9s, min = 6.8s, avg = 9.7s, dev = 2.3s //tensorflow/compiler/tests:matrix_diag_ops_test_cpu PASSED in 135.7s Stats over 8 runs: max = 135.7s, min = 6.6s, avg = 44.8s, dev = 43.0s //tensorflow/python/data/experimental/kernel_tests:csv_dataset_test PASSED in 31.2s Stats over 8 runs: max = 31.2s, min = 6.6s, avg = 14.7s, dev = 8.0s //tensorflow/python/data/kernel_tests:flat_map_test PASSED in 26.9s Stats over 8 runs: max = 26.9s, min = 12.8s, avg = 19.1s, dev = 4.7s //tensorflow/python/data/kernel_tests:tf_record_dataset_test PASSED in 28.6s Stats over 8 runs: max = 28.6s, min = 14.3s, avg = 20.0s, dev = 4.4s //tensorflow/python/keras:models_test PASSED in 28.6s Stats over 8 runs: max = 28.6s, min = 10.4s, avg = 19.5s, dev = 6.2s //tensorflow/python/keras/engine:base_layer_test PASSED in 15.5s Stats over 8 runs: max = 15.5s, min = 9.5s, avg = 12.7s, dev = 2.1s //tensorflow/python/keras/engine:functional_test PASSED in 29.8s Stats over 8 runs: max = 29.8s, min = 13.9s, avg = 20.9s, dev = 5.0s //tensorflow/python/keras/layers:convolutional_recurrent_test PASSED in 64.9s Stats over 8 runs: max = 64.9s, min = 36.1s, avg = 48.9s, dev = 9.1s //tensorflow/python/keras/layers:pooling_test PASSED in 25.9s Stats over 8 runs: max = 25.9s, min = 12.4s, avg = 18.7s, dev = 4.1s //tensorflow/python/keras/optimizer_v2:optimizer_v2_test PASSED in 121.8s Stats over 8 runs: max = 121.8s, min = 79.5s, avg = 102.6s, dev = 15.4s //tensorflow/python/kernel_tests/linalg:linalg_ops_test PASSED in 57.1s Stats over 8 runs: max = 57.1s, min = 30.6s, avg = 44.6s, dev = 10.5s //tensorflow/python/kernel_tests/linalg:linear_operator_block_lower_triangular_test PASSED in 85.0s Stats over 8 runs: max = 85.0s, min = 74.9s, avg = 80.8s, dev = 3.3s //tensorflow/python/kernel_tests/signal:fft_ops_test PASSED in 90.4s Stats over 8 runs: max = 90.4s, min = 12.7s, avg = 31.8s, dev = 28.1s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_ops_test NO STATUS in 36.0s Stats over 8 runs: max = 36.0s, min = 6.6s, avg = 15.2s, dev = 11.1s //tensorflow/compiler/tests:conv2d_test_cpu_mlir_bridge_test PASSED in 10.1s Stats over 10 runs: max = 10.1s, min = 4.9s, avg = 6.6s, dev = 1.6s //tensorflow/compiler/tests:image_ops_test_cpu PASSED in 27.2s Stats over 10 runs: max = 27.2s, min = 16.0s, avg = 21.9s, dev = 4.3s //tensorflow/compiler/tests:random_ops_test_cpu PASSED in 13.1s Stats over 10 runs: max = 13.1s, min = 5.4s, avg = 9.1s, dev = 2.5s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 44.3s Stats over 10 runs: max = 44.3s, min = 6.9s, avg = 21.9s, dev = 15.7s //tensorflow/compiler/xla/client/lib:tridiagonal_test_cpu PASSED in 3.5s Stats over 10 runs: max = 3.5s, min = 2.2s, avg = 2.8s, dev = 0.4s //tensorflow/python:special_math_ops_test PASSED in 40.4s Stats over 10 runs: max = 40.4s, min = 7.8s, avg = 14.3s, dev = 9.0s //tensorflow/python/data/kernel_tests:rejection_resample_test PASSED in 19.5s Stats over 10 runs: max = 19.5s, min = 6.8s, avg = 11.3s, dev = 4.1s //tensorflow/python/distribute:input_lib_test PASSED in 31.7s Stats over 10 runs: max = 31.7s, min = 23.7s, avg = 28.0s, dev = 2.5s //tensorflow/python/distribute:input_lib_type_spec_test PASSED in 22.5s Stats over 10 runs: max = 22.5s, min = 7.0s, avg = 14.1s, dev = 5.1s //tensorflow/python/framework:function_test PASSED in 66.2s Stats over 10 runs: max = 66.2s, min = 4.0s, avg = 13.7s, dev = 17.8s //tensorflow/python/grappler:cluster_test PASSED in 13.2s Stats over 10 runs: max = 13.2s, min = 3.7s, avg = 7.7s, dev = 3.5s //tensorflow/python/keras/mixed_precision:layer_correctness_test PASSED in 80.3s Stats over 10 runs: max = 80.3s, min = 38.8s, avg = 55.1s, dev = 14.5s //tensorflow/python/kernel_tests/array_ops:array_ops_test PASSED in 17.2s Stats over 10 runs: max = 17.2s, min = 5.8s, avg = 10.8s, dev = 2.6s //tensorflow/python/kernel_tests/array_ops:inplace_ops_test PASSED in 7.6s Stats over 10 runs: max = 7.6s, min = 3.7s, avg = 4.8s, dev = 1.4s //tensorflow/python/kernel_tests/linalg:linear_operator_kronecker_test PASSED in 120.5s Stats over 10 runs: max = 120.5s, min = 106.6s, avg = 113.5s, dev = 5.6s //tensorflow/python/kernel_tests/linalg:linear_operator_low_rank_update_test PASSED in 174.9s Stats over 10 runs: max = 174.9s, min = 133.9s, avg = 154.7s, dev = 18.6s //tensorflow/python/kernel_tests/linalg:tridiagonal_matmul_op_test PASSED in 75.4s Stats over 10 runs: max = 75.4s, min = 4.2s, avg = 12.7s, dev = 20.9s //tensorflow/python/kernel_tests/nn_ops:pooling_ops_test PASSED in 39.1s Stats over 10 runs: max = 39.1s, min = 6.1s, avg = 21.8s, dev = 11.8s //tensorflow/python/kernel_tests/random:stateless_random_ops_test PASSED in 108.7s Stats over 10 runs: max = 108.7s, min = 74.7s, avg = 90.6s, dev = 13.3s //tensorflow/python/saved_model:load_test PASSED in 99.8s Stats over 10 runs: max = 99.8s, min = 40.2s, avg = 55.2s, dev = 15.8s //tensorflow/python/data/experimental/kernel_tests:group_by_reducer_test PASSED in 23.7s Stats over 12 runs: max = 23.7s, min = 4.9s, avg = 11.6s, dev = 5.8s //tensorflow/python/data/kernel_tests:memory_cleanup_test PASSED in 10.1s Stats over 12 runs: max = 10.1s, min = 5.8s, avg = 8.4s, dev = 1.3s //tensorflow/python/distribute:multi_process_runner_test PASSED in 232.6s Stats over 12 runs: max = 232.6s, min = 19.6s, avg = 57.2s, dev = 59.2s //tensorflow/python/keras/layers:gru_v2_test PASSED in 89.2s Stats over 12 runs: max = 89.2s, min = 36.8s, avg = 53.9s, dev = 17.1s //tensorflow/python/keras/layers:recurrent_test PASSED in 86.2s Stats over 12 runs: max = 86.2s, min = 35.4s, avg = 60.2s, dev = 16.2s //tensorflow/python:image_ops_test PASSED in 25.3s Stats over 16 runs: max = 25.3s, min = 6.2s, avg = 14.9s, dev = 4.8s //tensorflow/python/data/experimental/kernel_tests/service:coordinated_read_ft_test PASSED in 41.8s Stats over 16 runs: max = 41.8s, min = 7.9s, avg = 15.8s, dev = 11.1s //tensorflow/python/data/experimental/kernel_tests/service:coordinated_read_test PASSED in 35.3s Stats over 16 runs: max = 35.3s, min = 15.6s, avg = 21.2s, dev = 5.7s //tensorflow/python/data/experimental/kernel_tests/service:dynamic_sharding_test PASSED in 40.0s Stats over 16 runs: max = 40.0s, min = 29.0s, avg = 34.3s, dev = 3.2s //tensorflow/python/data/experimental/kernel_tests/service:worker_tags_test PASSED in 20.1s Stats over 16 runs: max = 20.1s, min = 3.3s, avg = 11.8s, dev = 4.9s //tensorflow/python/data/kernel_tests:snapshot_test PASSED in 69.8s Stats over 16 runs: max = 69.8s, min = 54.1s, avg = 60.5s, dev = 4.4s //tensorflow/python/kernel_tests/control_flow:control_flow_ops_py_test PASSED in 57.9s Stats over 16 runs: max = 57.9s, min = 39.6s, avg = 46.4s, dev = 5.5s //tensorflow/python/kernel_tests/signal:dct_ops_test PASSED in 11.8s Stats over 16 runs: max = 11.8s, min = 5.8s, avg = 8.4s, dev = 2.0s //tensorflow/python/ops/parallel_for:control_flow_ops_test PASSED in 91.2s Stats over 16 runs: max = 91.2s, min = 10.1s, avg = 24.7s, dev = 17.9s //tensorflow/python/data/kernel_tests:map_test PASSED in 29.6s Stats over 19 runs: max = 29.6s, min = 13.0s, avg = 20.4s, dev = 4.8s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 8.3s Stats over 20 runs: max = 8.3s, min = 3.5s, avg = 4.6s, dev = 1.0s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 7.9s Stats over 20 runs: max = 7.9s, min = 3.6s, avg = 5.0s, dev = 1.4s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 16.9s Stats over 20 runs: max = 16.9s, min = 3.1s, avg = 7.1s, dev = 3.4s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test PASSED in 7.3s Stats over 20 runs: max = 7.3s, min = 3.1s, avg = 4.2s, dev = 1.3s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 13.7s Stats over 20 runs: max = 13.7s, min = 3.5s, avg = 6.8s, dev = 2.5s //tensorflow/python/kernel_tests/linalg:linalg_grad_test PASSED in 59.9s Stats over 20 runs: max = 59.9s, min = 23.4s, avg = 36.3s, dev = 11.2s //tensorflow/python/kernel_tests/linalg:norm_op_test PASSED in 7.6s Stats over 20 runs: max = 7.6s, min = 3.8s, avg = 4.7s, dev = 1.1s //tensorflow/python/kernel_tests/linalg:normalize_op_test PASSED in 12.8s Stats over 20 runs: max = 12.8s, min = 5.2s, avg = 8.6s, dev = 2.3s //tensorflow/python/kernel_tests/linalg:qr_op_test PASSED in 166.5s Stats over 20 runs: max = 166.5s, min = 29.9s, avg = 93.3s, dev = 44.6s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test PASSED in 14.9s Stats over 20 runs: max = 14.9s, min = 5.6s, avg = 8.9s, dev = 2.7s //tensorflow/python/kernel_tests/math_ops:matmul_op_test PASSED in 26.9s Stats over 20 runs: max = 26.9s, min = 14.9s, avg = 20.4s, dev = 3.3s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test PASSED in 23.6s Stats over 20 runs: max = 23.6s, min = 4.0s, avg = 7.5s, dev = 4.6s //tensorflow/python/data/experimental/kernel_tests:directed_interleave_dataset_test PASSED in 22.0s Stats over 24 runs: max = 22.0s, min = 3.5s, avg = 10.2s, dev = 5.4s //tensorflow/python/keras/engine:training_integration_test PASSED in 38.9s Stats over 30 runs: max = 38.9s, min = 11.0s, avg = 23.5s, dev = 10.0s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test PASSED in 14.8s Stats over 30 runs: max = 14.8s, min = 3.4s, avg = 8.2s, dev = 3.2s //tensorflow/python/data/experimental/kernel_tests/service:auto_shard_test PASSED in 15.5s Stats over 32 runs: max = 15.5s, min = 3.3s, avg = 10.8s, dev = 3.2s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 28.3s Stats over 32 runs: max = 28.3s, min = 8.3s, avg = 14.7s, dev = 4.6s //tensorflow/python/distribute/coordinator:fault_tolerance_test FLAKY, failed in 2 out of 38 in 500.1s Stats over 38 runs: max = 500.1s, min = 8.3s, avg = 44.8s, dev = 75.6s /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/distribute/coordinator/fault_tolerance_test/shard_9_of_36/test_attempts/attempt_1.log /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/distribute/coordinator/fault_tolerance_test/shard_33_of_36/test_attempts/attempt_1.log //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test PASSED in 15.4s Stats over 50 runs: max = 15.4s, min = 4.5s, avg = 8.3s, dev = 2.6s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test PASSED in 8.3s Stats over 50 runs: max = 8.3s, min = 3.2s, avg = 4.8s, dev = 1.4s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test PASSED in 34.5s Stats over 50 runs: max = 34.5s, min = 3.7s, avg = 11.5s, dev = 7.6s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test PASSED in 17.6s Stats over 50 runs: max = 17.6s, min = 3.2s, avg = 6.3s, dev = 3.2s //tensorflow/python/distribute/coordinator:cluster_coordinator_test FLAKY, failed in 2 out of 52 in 44.3s Stats over 52 runs: max = 44.3s, min = 5.2s, avg = 9.1s, dev = 5.5s /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/distribute/coordinator/cluster_coordinator_test/shard_40_of_50/test_attempts/attempt_1.log /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/distribute/coordinator/cluster_coordinator_test/shard_40_of_50/test_attempts/attempt_2.log
Executed 2138 out of 2843 tests: 2136 tests pass, 1 fails to build and 706 were skipped. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=44 changed=27 unreachable=0 failed=1 skipped=9 rescued=0 ignored=0
Wednesday 17 November 2021 19:58:22 +0000 (1:02:12.288) 1:47:50.368 **** =============================================================================== tensorflow : Run unit tests on TensorFlow git for cp36-cp36m --------- 3732.29s tensorflow : build TensorFlow git for cp36-cp36m --------------------- 1784.12s python : build wheels of Python package h5py~=3.1.0 ------------------- 427.55s python : build wheels of Python package Keras_Applications ------------ 251.41s install bazel build requirements --------------------------------------- 54.05s python : install numpy build requirements ------------------------------ 37.93s tensorflow : populate cp36-cp36m virtualenv ---------------------------- 36.28s python : install h5py build requirements ------------------------------- 23.58s fetch tensorflow from git ---------------------------------------------- 20.98s bazel : fetch Bazel 3.7.2 binary from Github --------------------------- 16.55s python : create cp36-cp36m virtualenv ---------------------------------- 14.64s python : build wheels of Python package grpcio -------------------------- 8.79s install tensorflow build requirements ----------------------------------- 7.64s python : build wheels of Python package scipy --------------------------- 6.67s python : install scipy-1.5.4-cp36-cp36m-manylinux2014_aarch64.whl Python package --- 6.62s python : build wheels of Python package numpy~=1.19.5 ------------------- 5.29s python : build wheels of Python package Keras_Preprocessing ------------- 5.10s Gathering Facts --------------------------------------------------------- 4.55s tensorflow : remove TensorFlow git sources from previous build ---------- 4.28s python : enable EPEL ---------------------------------------------------- 3.02s Build step 'Execute shell' marked build as failure