GigaToken: ~1000x faster Language model tokenization

Gigatoken is a Rust-based tokenizer that achieves speeds of up to GB/s, making it 1000x faster than HuggingFace's tokenizers. It uses SIMD and cache hierarchies for optimization.