summaryrefslogtreecommitdiff
path: root/test/spec_tests.py
AgeCommit message (Collapse)Author
2014-12-22Merge pull request #248 from cirosantilli/short-optionsJohn MacFarlane
spec_tests add short options for common parameters
2014-12-22Merge pull request #247 from cirosantilli/run-single-test-by-numberJohn MacFarlane
Add --number option to run a single test by its id
2014-12-22Slight improvement to #250.John MacFarlane
Indicate which is expected and which is actual output.
2014-12-21Don't raise exception on invalid UTF-8 outputCiro Santilli
This could be reproduced with: ./test/spec_tests.py --program kramdown --pattern Enti with Kramdown version 1.5.0. The main problem is that it would stop future tests from being carried out. After this commit it is just counted as a failure. The error message printed is of the form: Unicode error: 'utf8' codec can't decode byte 0xfc in position 8: invalid start byte '<p># \xd3\x92 \xcf\xa0 \xef\xbf\xbd</p>\n' '<p># \xd3\x92 \xcf\xa0 \xfc\x85\xb8\xb0\xa9\xb8</p>\n'
2014-12-21spec_tests add short options for common parametersCiro Santilli
2014-12-21Add --number option to run a single test by its idCiro Santilli
Do not check input validity, e.g. input `>` number of tests, because other inputs don't check it either, e.g. `--pattern`. If given, the summary line will be like: 1 passed, 0 failed, 0 errored, 509 skipped
2014-12-01make the diff output workCarsten Brandt
2014-12-01fixed python scriptCarsten Brandt
all these variables are not defined and have to be extracted from `test`. Running the script this way resulted in error: ``` python cmm/test/spec_tests.py --spec cmm/spec.txt --program "./bin/markdown --flavor=common" Traceback (most recent call last): File "cmm/test/spec_tests.py", line 137, in <module> if do_tests(cmark, tests, args.pattern, args.normalize): File "cmm/test/spec_tests.py", line 114, in do_tests result = do_test(test, normalize) File "cmm/test/spec_tests.py", line 47, in do_test print_test_header(headertext, example_number,start_line,end_line) NameError: global name 'headertext' is not defined ```
2014-11-29More code cleanup in spec_tests.py.John MacFarlane
2014-11-29Reorganized code in spec_tests.py.John MacFarlane
2014-11-29test: Factored out normalization code into normalize.py.John MacFarlane
2014-11-29spec_tests.py: if dump_args, don't try to load dynamic library.John MacFarlane
2014-11-29Factored out cmark.py from test programs.John MacFarlane
2014-11-29Moved testing programs to test/.John MacFarlane
Added test/CMakeLists.txt.