summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2015-07-10Updates for new HTML block spec.John MacFarlane
* Rewrote spec for HTML blocks. A few other spec examples also changed as a result. * Removed old `html_block_tag` scanner. Added new `html_block_start` and `html_block_start_7`, as well as `html_block_end_n` for n = 1-5. * Rewrote block parser for new HTML block spec.
2015-07-09Implemented new treatment of dashes with `--smart`.John MacFarlane
2015-07-09Updated test/smart_punct.txt.John MacFarlane
This incorporates the changes in jgm/commonmark.js#58. Sequences of hyphens are converted to sequences of em and en dashes, with no hyphens. Currently this test fails.
2015-07-09Fixed small bug in test runner.John MacFarlane
(Error printing errors from the test program.)
2015-07-08spec_tests.py: use stdout.out.buffer.write instead of print throughout.John MacFarlane
Mixing them didn't work well; results were out of order.
2015-07-07Updated spec_tests.py from jgm/CommonMark.John MacFarlane
This forces utf-8 encoding.
2015-07-07Fixed compiler warnings.John MacFarlane
2015-07-06Use sprintf rather than snprintf because we know it won't overflow.John MacFarlane
A rendered int can't be 20 digits.
2015-07-05Another try at getting snprintf part to compile on Windows.John MacFarlane
2015-07-05Fixed typo in Windows fix.John MacFarlane
2015-07-05LaTeX writer: fixed some compile errors on MSVC.John MacFarlane
2015-07-05LaTeX writer: Fixed straight single, double quote.John MacFarlane
Added comments about required packages.
2015-07-05LaTeX renderer: \textbf for strong.John MacFarlane
2015-07-05astyle formatting improvements.John MacFarlane
2015-07-05Added LaTeX renderer.John MacFarlane
* New exported function in API: `cmark_render_latex`. * Added src/latex.hs. * Updated README and man page. * Closes #31.
2015-07-05commonmark writer: correctly handle email autolinks.John MacFarlane
2015-07-03Use utf-8 aware re2c.John MacFarlane
2015-07-03`spec_test.py`: changed default to `spec.txt` (not `test/spec.txt`).John MacFarlane
This doesn't matter, since we specify the argument anyway. But it brings this into sync with the version in CommonMark.
2015-07-01html renderer: properly split info on first space char.John MacFarlane
See jgm/commonmark.js#54.
2015-06-26Merge pull request #61 from txdv/version-functions-ffiJohn MacFarlane
Changed version variables to functions.
2015-06-25Changed version variables to functions.Andrius Bentkus
This is easier to access using ffi, since some languages, like C# like to use only function interfaces for accessing library functionality. fixes #60
2015-06-18Added algorithm.md, informal explanation of emph/link parsing.John MacFarlane
2015-06-18process_emphasis: Fixed setting lower bound to potential openers.John MacFarlane
2015-06-18Rename potential_openers -> openers_bottom.John MacFarlane
2015-06-18Rename start_delim -> stack_bottom.John MacFarlane
2015-06-18Minor astyle reformatting.John MacFarlane
2015-06-17Added case for #59 to pathological_test.py.John MacFarlane
2015-06-17Fixed emphasis/link parsing bug.John MacFarlane
Closes #59.
2015-06-17Fixed off-by-one error in line splitting routine.John MacFarlane
This caused certain NULLs not to be replaced. Found my 'make fuzztest'.
2015-06-17Added assertion to peek_char to catch any stray NULLs.John MacFarlane
Note that our current procedure for removing nulls is not working properly.
2015-06-17README: added 'make afl' instructions.John MacFarlane
2015-06-17Small changes to README and benchmark files.John MacFarlane
2015-06-17Renamed entities.h -> entities.inc.John MacFarlane
Also tools/make_entities_h.py -> tools/make_entitis_inc.py.
2015-06-16Updated benchmarks.John MacFarlane
2015-06-16Added `CMARK_OPT_VALIDATE_UTF8` option.John MacFarlane
Also command line option `--validate-utf8`. This option causes cmark to check for valid UTF-8, replacing invalid sequences with the replacement character, U+FFFD. Reinstated api tests for utf8.
2015-06-16Small code simplification in inlines.c.John MacFarlane
Use S_is_line_end_char.
2015-06-16is_blank: recognize tab as a blank character.John MacFarlane
2015-06-16skip_spaces: skip tabs too.John MacFarlane
2015-06-16Don't rtrim in subject_from_buffer.John MacFarlane
This gives bad results in parsing reference links, where we might have trailing blanks. (finalize in blocks.c removes the bytes parsed as a reference definition; before this change, some blank bytes might remain on the line.)
2015-06-16Removed utf8 validation tests.John MacFarlane
We no longer validate utf8 before parsing.
2015-06-16Removed utf8 validation.John MacFarlane
We now replace null characters in the line splitting code.
2015-06-16Updated spec for new tab behavior.John MacFarlane
This change will need to be ported to CommonMark if we do this. We no longer replace spaces with tabs. Rather, we treat tabs as equivalent spaces for purposes of determining structure. Tab stop is still 4. Tabs in the text remain in the text.
2015-06-16Renamed utf8proc_detab as utf8proc_check, removed detabbing function.John MacFarlane
Now it just replaces bad UTF-8 sequences and NULLs. This restores benchmarks to near their previous levels.
2015-06-16Preliminary changes for new tab handling.John MacFarlane
We no longer preprocess tabs to spaces before parsing. Instead, we keep track of both the byte offset and the (virtual) column as we parse block starts. This allows us to handle tabs without converting to spaces first. Tabs are left as tabs in the output. Added `column` and `first_nonspace_column` fields to `parser`. Added utility function to advance the offset, computing the virtual column too. Note that we don't need to deal with UTF-8 here at all. Only ASCII occurs in block starts. Significant performance improvement due to the fact that we're not doing UTF-8 validation -- though we might want to add that back in.
2015-06-16spec_tests.py: allow → for tab in HTML examples.John MacFarlane
2015-06-16normalize.py: don't collapse whitespace in pre contexts.John MacFarlane
2015-06-16Simpler approach for entity lookup.John MacFarlane
We dispense with the hashes and just do string comparsions. Since the array is in order, we can search intelligently and should never need to do more than 8 or so comparisons. This reduces binary size even further, at a small cost in performance. (This shouldn't matter too much, as it's only detectable in really entity-heavy sources.)
2015-06-16make_entities_h.py: confirm there are no hash collisions.John MacFarlane
At least with valid data.
2015-06-16Revert "Rebuild src/entities.h when the generating python program changes."John MacFarlane
This reverts commit e113185554c4d775e6fca0596011b405fa1700a5.
2015-06-16Rebuild src/entities.h when the generating python program changes.John MacFarlane