Paul Yang 9bda1f19bf Adopt upb change for timestamp and duration json to php (#5106)		7 years ago
..
third_party	a0cecfd31a Make conformance tests build for C++ and Java.	9 years ago
ConformanceJava.java	6bbe197e9c Down-integrate from google3.	7 years ago
ConformanceJavaLite.java	3808d091f8 Fix spelling in strings and comments	9 years ago
Makefile.am	98e26a4195 Add missing reference to conformanc_test_impl.cc in Makefile (#5100)	7 years ago
README.md	afe98de32a Replace repo links.	7 years ago
autoload.php	bcda919cee Fix php well known type conformance tests (#3828)	8 years ago
conformance.proto	6bbe197e9c Down-integrate from google3.	7 years ago
conformance_cpp.cc	6bbe197e9c Down-integrate from google3.	7 years ago
conformance_nodejs.js	3adb054bbf add some test proto2 supported, add js proto2 supported, fixed some error	8 years ago
conformance_objc.m	3caf9fd00a Review feedback.	8 years ago
conformance_php.php	6bbe197e9c Down-integrate from google3.	7 years ago
conformance_python.py	6bbe197e9c Down-integrate from google3.	7 years ago
conformance_ruby.rb	3adb054bbf add some test proto2 supported, add js proto2 supported, fixed some error	8 years ago
conformance_test.cc	5aeee3dc91 Add source dependency of test suite implementation to main function (#5069)	7 years ago
conformance_test.h	5aeee3dc91 Add source dependency of test suite implementation to main function (#5069)	7 years ago
conformance_test_impl.cc	5aeee3dc91 Add source dependency of test suite implementation to main function (#5069)	7 years ago
conformance_test_runner.cc	5aeee3dc91 Add source dependency of test suite implementation to main function (#5069)	7 years ago
failure_list_cpp.txt	6bbe197e9c Down-integrate from google3.	7 years ago
failure_list_csharp.txt	6bbe197e9c Down-integrate from google3.	7 years ago
failure_list_java.txt	6bbe197e9c Down-integrate from google3.	7 years ago
failure_list_js.txt	188755c065 Fix JS conformance tests	8 years ago
failure_list_objc.txt	ecc0f54127 Properly error on a tag with field number zero.	8 years ago
failure_list_php.txt	bcda919cee Fix php well known type conformance tests (#3828)	8 years ago
failure_list_php_c.txt	9bda1f19bf Adopt upb change for timestamp and duration json to php (#5106)	7 years ago
failure_list_php_zts_c.txt	ecca6ea95d Add json encode/decode for php. (#3226)	8 years ago
failure_list_python-post26.txt	6bbe197e9c Down-integrate from google3.	7 years ago
failure_list_python.txt	6bbe197e9c Down-integrate from google3.	7 years ago
failure_list_python_cpp.txt	6bbe197e9c Down-integrate from google3.	7 years ago
failure_list_ruby.txt	98e26a4195 Add missing reference to conformanc_test_impl.cc in Makefile (#5100)	7 years ago
update_failure_list.py	45483fd1c0 file() was removed in Python 3, use open() instead	8 years ago

Protocol Buffers - Google's data interchange format

This directory contains conformance tests for testing completeness and correctness of Protocol Buffers implementations. These tests are designed to be easy to run against any Protocol Buffers implementation.

This directory contains the tester process conformance-test, which contains all of the tests themselves. Then separate programs written in whatever language you want to test communicate with the tester program over a pipe.

Before running any of these tests, make sure you run make in the base directory to build protoc, since all the tests depend on it.

$ make

Running the tests for C++

To run the tests against the C++ implementation, run:

$ cd conformance && make test_cpp

Running the tests for JavaScript (Node.js)

To run the JavaScript tests against Node.js, make sure you have "node" on your path and then run:

$ cd conformance && make test_nodejs

Running the tests for Ruby (MRI)

To run the Ruby tests against MRI, first build the C extension:

$ cd ruby && rake

Then run the tests like so:

$ cd conformance && make test_ruby

Running the tests for other languages

Most of the languages in the Protobuf source tree are set up to run conformance tests. However some of them are more tricky to set up properly. See tests.sh in the base of the repository to see how Travis runs the tests.

Testing other Protocol Buffer implementations

To run these tests against a new Protocol Buffers implementation, write a program in your language that uses the protobuf implementation you want to test. This program should implement the testing protocol defined in conformance.proto. This is designed to be as easy as possible: the C++ version is only 150 lines and is a good example for what this program should look like (see conformance_cpp.cc). The program only needs to be able to read from stdin and write to stdout.

Portability

Note that the test runner currently does not work on Windows. Patches to fix this are welcome! (But please get in touch first to settle on a general implementation strategy).

README.md