aboutsummaryrefslogtreecommitdiff
path: root/c/tools
AgeCommit message (Collapse)AuthorFilesLines
2024-01-15add brcat alias + flag to decompress concatenated streamsEvgenii Kliuchnikov2-50/+128
PiperOrigin-RevId: 598652401
2024-01-11add comment (fingerprint) CLI featureEvgenii Kliuchnikov1-12/+182
PiperOrigin-RevId: 597489910
2023-08-25comb HAVE_UTIMENSAT definitionEvgenii Kliuchnikov1-5/+11
PiperOrigin-RevId: 560011681
2023-07-31add option to delete files that are not "compressed"Evgenii Kliuchnikov1-9/+50
PiperOrigin-RevId: 552472135
2023-07-30simplify CMake buildEvgenii Kliuchnikov1-3/+3
PiperOrigin-RevId: 552238545
2023-07-10verbose error report in CLIEvgenii Kliuchnikov1-1/+28
PiperOrigin-RevId: 546833411
2022-12-22Copy ns time stat (#992)Eugene Kliuchnikov1-10/+35
2022-11-17UpdateEvgenii Kliuchnikov2-15/+14
Documentation: - add note that brotli is a "stream" format, not an archive-like - regenerate .1 with Pandoc Build: - drop legacy "BROTLI_BUILD_PORTABLE" option - drop "BROTLI_SANITIZED" definition Code: - c: comb includes - c/enc: extract encoder state into separate header - c/enc: drop designated q10 codepath - c/enc: dealing better with flushing of empty stream - fix MSVC compilation API: - py: use library version instead of one in version.h - c: add plugable API to report consumed input / produced output - c/java: support "lean" prepared dictionaries (without copy of source)
2021-11-10Prepare for copybara (#939)Eugene Kliuchnikov1-1/+1
Co-authored-by: Eugene Kliuchnikov <eustas@chromium.org>
2021-09-08Strip "./" in includes (#925)Eugene Kliuchnikov1-1/+1
Co-authored-by: Eugene Kliuchnikov <eustas@chromium.org>
2021-08-04Merge-in SharedDictionary feature (#916)Eugene Kliuchnikov2-1/+99
Co-authored-by: Eugene Kliuchnikov <eustas@chromium.org>
2020-09-07add execution time (#834)Pavel Rosický1-0/+8
2020-07-02Mute strerror/strcpy warnings is MSVC build. (#815)Eugene Kliuchnikov1-0/+5
2020-07-02Add workaround for lying feof. (#814)Eugene Kliuchnikov1-1/+5
Should fix #812
2019-07-17Update (#762)Eugene Kliuchnikov1-3/+3
* put LICENSE file into .jar * fix typo * add clarification comment in PY wrapper
2019-04-12Update (#749)Eugene Kliuchnikov1-3/+9
Update: * Bazel: fix MSVC configuration * C: common: extended documentation and helpers around distance codes * C: common: enable BROTLI_DCHECK in "debug" builds * C: common: fix implicit trailing zero in `kPrefixSuffix` * C: dec: fix possible bit reader discharge for "large-window" mode * C: dec: simplify distance decoding via lookup table * C: dec: reuse decoder state members memory via union with lookup table * C: dec: add decoder state diagram * C: enc: clarify access to static dictionary * C: enc: improve static dictionary hash * C: enc: add "stream offset" parameter for parallel encoding * C: enc: reorganize hasher; now Q2-Q3 require exactly 256KiB to avoid global TCMalloc lock * C: enc: fix rare access to uninitialized data in ring-buffer * C: enc: reorganize logging / checks in `write_bits.h` * Java: dec: add "large-window" support * Java: dec: improve speed * Java: dec: debug and 32-bit mode are now activated via system properties * Java: dec: demystify some state variables (use better names) * Dictionary generator: add single input mode * Java: dec: modernize tests * Bazel: js: pick working commit for closure rules
2018-10-24Verbose CLI + start pulling "Shared-Brotli" (#722)Eugene Kliuchnikov1-7/+47
* Verbose CLI + start pulling "Shared-Brotli" * vesbose CLI output; fix #666 * pull `SHIFT` transforms; currently this is semantically dead code; later it will be used by "Shared-Brotli"
2018-10-02tools/brotli: improve window size autodetect (#710)Alexey Ivanov1-3/+2
Window size is defined as: `(1 << BROTLI_PARAM_LGWIN) - 16` in `c/include/brotli/encode.h` Therefore we should probably take these 16 bytes into account. Done basic manual testing: $ python3 -c 'print ("A"*2046)' > t $ bazel run -- //:brotli -w 0 -f -o $(realpath t).br $(realpath ./t) $ python3 research/brotlidump.py t.br |& fgrep WSIZE 0000 c1 1000001 WSIZE windowsize=(1<<12)-16=4080 New version properly detects window size of `4080`, while previous one used `2032`: $ python3 research/brotlidump.py t.br |& fgrep WSIZE 0000 b1 0110001 WSIZE windowsize=(1<<11)-16=2032
2018-04-13Update (#660)Eugene Kliuchnikov1-1/+1
* Update * improve q=1 compression on small files * fix "left shift before promotion" * fix osx Travis builds
2018-03-27Update (#656)Eugene Kliuchnikov1-12/+41
* proper fix for the "fall through" warning" * automatic NDIRECT/NPOSTFIX tuning (better compression) * fix unaligned access for `aarch64`-cross-`armhf` build * fix `aarch64` detection (10% decoder speedup) * expose `large_window` CLI option * make default window size 16MiB * ramp up version to 1.0.4
2018-03-20Update (#651)Eugene Kliuchnikov1-33/+142
* fix `bazel` build (ignore switch case fall-through) * add `NPOSTFIX` / `NDIRECT` encoder parameters * fix source file lists (add `params.h`) * fix bug in `durchschlag` * print clarifying messages wheb CLI argument parsing fails
2018-02-26New feature: "Large Window Brotli" (#640)Eugene Kliuchnikov1-63/+126
* New feature: "Large Window Brotli" By setting special encoder/decoder flag it is now possible to extend LZ-window up to 30 bits; though produced stream will not be RFC7932 compliant. Added new dictionary generator - "DSH". It combines speed of "Sieve" and quality of "DM". Plus utilities to prepare train corpora (remove unique strings). Improved compression ratio: now two sub-blocks could be stitched: the last copy command could be extended to span the next sub-block. Fixed compression ineffectiveness caused by floating numbers rounding and wrong cost heuristic. Other C changes: - combined / moved `context.h` to `common` - moved transforms to `common` - unified some aspects of code formatting - added an abstraction for encoder (static) dictionary - moved default allocator/deallocator functions to `common` brotli CLI: - window size is auto-adjusted if not specified explicitly Java: - added "eager" decoding both to JNI wrapper and pure decoder - huge speed-up of `DictionaryData` initialization * Add dictionaryless compressed dictionary * Fix `sources.lst` * Fix `sources.lst` and add a note that `libtool` is also required. * Update setup.py * Fix `EagerStreamTest` * Fix BUILD file * Add missing `libdivsufsort` dependency * Fix "unused parameter" warning.
2017-10-10Fix permissions of various files in project (#613)Tomáš Popela2-0/+0
Move from 755 to 644.
2017-09-20Fix API documentation + theoretical NPEs (#602)v1.0.0Eugene Kliuchnikov1-5/+7
2017-09-19Update: (#600)Eugene Kliuchnikov1-0/+12
* encoder: relax backward references candidates asserts * encoder: make RNG more platform-independent * encoder: remove "unused" param (context mode) * CLI: improve first-encounter experience * Java: update SynthTest * Java: refine proguard config * Java/JNI: fix one-shot compression workflow
2017-09-07Update (#593)Eugene Kliuchnikov1-44/+42
* Update: * fix CLI error messages * fix CLI console IO on Windows
2017-08-24Update (#589)Eugene Kliuchnikov1-1/+1
* cleanup * fix `unbrotli` CLI * Java retouch for faster JS decoder
2017-08-04Update API, and more (#581)Eugene Kliuchnikov2-96/+2
Update API, and more: * remove "custom dictionary" support * c/encoder: fix #580: big-endian build * Java: reduce jar size * Java: speedup decoding * Java: add 32-bit CPU support * Java: make source code JS transpiler-ready
2017-07-21Update (#574)custom-dictionaryEugene Kliuchnikov1-5/+7
* Update * decoder: better behavior after failure * encoder: replace "len_x_code" with delta * research: add experimental dictionary generator * python: test combing
2017-06-30Update (#569)Eugene Kliuchnikov1-0/+4
* add misssing fclose in `brotli.c` * add basic tests for python `Decompressor` type * minor lint fixes in `_brotli.cc`
2017-06-13Update (#560)Eugene Kliuchnikov1-2/+2
Update: * add decoder API to avoid ringbuffer reallocation * fix MSVC warnings * remove dead code
2017-05-29Update (#555)Eugene Kliuchnikov3-521/+1044
Update: * new CLI; bro -> brotli; + man page * JNI wrappers preparation (for bazel build) * add raw binary dictionary representation `dictionary.bin` * add ability to side-load brotli RFC dictionary * decoder persists last error now * fix `BrotliDecoderDecompress` documentation * go reader don't block until necessary * more consistent bazel target names * Java dictionary data compiled footprint reduced * Java tests refactoring
2017-04-23Move files & update paths (#541)Eugene Kliuchnikov1-0/+521
* Move files & update paths * Rename build to scripts. * Fix paths * Fix script.
generated by cgit v1.1 at 2024-08-17 06:47:53 +0000