added hooks for compression in token.c