Esun Kim 76afc77ff6 Update PHP & Ruby Mac BUILD 4 tahun lalu
..
artifacts 76afc77ff6 Update PHP & Ruby Mac BUILD 4 tahun lalu
build_stats 5c79a3199c cleanup tools/run_tests directory 8 tahun lalu
dockerize 61f66e81b6 tools: Put sha1 in container tag instead of name 5 tahun lalu
generated e7b9404dc0 Added grpc_stacktrace_minloglevel 4 tahun lalu
helper_scripts 5527e0f328 Simplify the check with existing if 5 tahun lalu
interop 8cb2d0546d Upgrade sanity Docker image to debian:stretch 6 tahun lalu
lb_interop_tests 7be821ac47 Yapf all target python sources 5 tahun lalu
performance 8b775834d6 add "scenarios" top level element 4 tahun lalu
python_utils 511af22c78 Hopefully fixed 27 build on winserver2016 4 tahun lalu
sanity 1f670397ce Remove gflags. 4 tahun lalu
README.md ce644736fe remove leftovers of stress tests 7 tahun lalu
run_grpclb_interop_tests.py 7be821ac47 Yapf all target python sources 5 tahun lalu
run_interop_tests.py 3208a98787 try setting GO111MODULE in interop test runner 4 tahun lalu
run_microbenchmark.py 648c38380b run_microbenchmark.py should use bazel 5 tahun lalu
run_performance_tests.py 7be821ac47 Yapf all target python sources 5 tahun lalu
run_tests.py d908f6fc18 Extend the timeout for ios-cpp-test-cronet 5 tahun lalu
run_tests_matrix.py 60b5d06ec1 replace to php7 5 tahun lalu
run_xds_tests.py 057c1d1faf Do not try to generate unique suffix when keep_gcp_resources is set 4 tahun lalu
start_port_server.py b6e5827315 remove python version number 6 tahun lalu
task_runner.py 37c980d98a improve python3 compatibility of the task_runner.py script 5 tahun lalu

README.md

Overview

This directory contains scripts that facilitate building and running tests. We are using python scripts as entrypoint for our tests because that gives us the opportunity to run tests using the same commandline regardless of the platform you are using.

Unit tests (run_tests.py)

Builds gRPC in given language and runs unit tests. Use tools/run_tests/run_tests.py --help for more help.

Example

tools/run_tests/run_tests.py -l csharp -c dbg

Useful options (among many others)
  • --use_docker Builds a docker container containing all the prerequisites for given language and runs the tests under that container.
  • --build_only Only build, do not run the tests.

Note: If you get an error such as ImportError: No module named httplib2, then you may be missing some Python modules. Install the module listed in the error and try again.

Note: some tests may be flaky. Check the "Issues" tab for known flakes and other issues.

The full suite of unit tests will take many minutes to run.

Interop tests (run_interop_tests.py)

Runs tests for cross-platform/cross-language interoperability. For more details, see Interop tests descriptions The script is also capable of running interop tests for grpc-java and grpc-go, using sources checked out alongside the ones of the grpc repository.

Example

tools/run_tests/run_interop_tests.py -l csharp -s c++ --use_docker (run interop tests with C# client and C++ server)

Note: if you see an error like no space left on device when running the interop tests using Docker, make sure that Docker is building the image files in a location with sufficient disk space.

Performance benchmarks (run_performance_tests.py)

Runs predefined benchmark scenarios for given languages. Besides the simple configuration of running all the scenarios locally, the script also supports orchestrating test runs with client and server running on different machines and uploading the results to BigQuery.

Example

tools/run_tests/run_performance_tests.py -l c++ node

Useful options
  • --regex use regex to select particular scenarios to run.

Artifacts & Packages (task_runner.py)

A generalized framework for running predefined tasks based on their labels. We use this to building binary artifacts & distrib packages and testing them)

Example

tools/run_tests/task_runner.py -f python artifact linux x64 (build tasks with labels python, artifact, linux, and x64)