PAQ8PX – Experimental Lossless Data Compressor & Entropy Estimator
compression entropy data-compression image-compression text-compression audio-compression lossless-image-compression paq entropy-estimation
- Updated
- C++
#
text-compression
Here are 99 public repositories matching this topic...
AI-powered text compression library for RAG systems and API calls. Reduce token usage by up to 50-60% while preserving semantic meaning with advanced compression strategies.
python nlp machine-learning ai transformers openai neural-networks summarization text-processing text-compression cost-optimization extractive rag fastapi llm langchain anthropic token-reduction semantic-compression api-optimization
- Updated
- Python
Offline Dictionary-based Compression (Re-Pair, Recursive Pairing)
- Updated
- C
Code and data for VTCBench, a VLM benchmark for long-context understanding capabilities under vision-text compression paradigm.
text-compression large-language-model vision-language-model llm-memory deepseek-ocr context-cascade-compression
- Updated
- Python
LLMA = LLM + Arithmetic coder, which use LLM to do insane text data compression. LLMA=大模型+算术编码，它能使用LLM对文本数据进行暴力的压缩，达到极高的压缩率。
- Updated
- Python
Extreme inline text compression for HTML / JS. A custom pipeline that generates stand-alone HTML or JS files which embed competitively compressed self-extracting text, with file sizes of 25% - 40% the original.
base64 compression yenc binary-to-text text-compression burrows-wheeler-transform huffman-decoder base122 move-to-front png-bootstrap base125 crenc
- Updated
- Python
本项目是基于 Java 实现的哈夫曼编码文本压缩解压工具，按照字符频率构建哈夫曼树、生成哈夫曼编码映射、压缩解压文件。 This project is a Huffman coding-based text compression and decompression tool implemented in Java. It constructs a Huffman tree according to character frequencies, generates Huffman coding mappings, and enables file compression and decompression.
- Updated
- Java
🍶 llm-distillery ⇢ use LLMs to run map-reduce summarization tasks on large documents until a target token size is met.
text-summarization text-processing tokenization text-compression token-management openai-api llm large-language-model semantic-chunking text-distillation ai-text-reduction
- Updated
- JavaScript
This project is about the implementation of the LZ77 and Deflate COMPRESSION algorithm.
c data lz77 data-compression compression-algorithm deflate text-compression deflate-algorithm lz77-compression-algorithm data-compressor lzz deflate-compare-lz77
- Updated
- C
A simple visualization for huffman tree, which is used in encoding text.
- Updated
- JavaScript
Cross platform diff engine for .net core used to compare string values and generate a comparison output
- Updated
- C#
Using Huffman code to encode and compress the secret text data along with using histogram shifting to encode the data into the image.
steganography image-encryption image-steganography text-compression text-encoding steganography-algorithms image-encoding python-steganography
- Updated
- Python
Easy data compression algorithm.
open-source binary-data pattern-matching innovation data-compression data-processing compression-algorithm text-compression fsp algorithm-design file-compression delta-encoding computer-science-project similarity-detection lossless-compression efficient-storage lgpl-3-0 compression-technique
- Updated
- HTML
LZ77 algorithm, providing efficient lossless data compression and decompression capabilities. It offers a reliable and flexible solution for reducing file sizes in various programming languages.
c data algorithms cpp data-compression compression-algorithm deflate text-compression lz77-compression-algorithm data-compressor lzz deflate-compare-lz77 deflate-compression
- Updated
- C++
An attempt to compress the enwik8 file
compression linked-list multimedia huffman bwt bwtool lzw text-compression variable-length mtf compression-application enwik8
- Updated
- C++
A text compression tool & library
- Updated
- Python
Data driven approach for compressing text using an encoder-decoder architecture and word-level embeddings.
- Updated
- Python
Improve this page
Add a description, image, and links to the text-compression topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the text-compression topic, visit your repo's landing page and select "manage topics."