Network conscious text compression system (NCTCSys)

Abstract

This paper proposes a "network conscious text compression system" (NCTCSys) to tackle the problem of transmitting explosively increasing data on the Internet. It can be integrated into different text based transfer protocols like FTP, HTTP and SMTP at the application level to handle text data transmission. We apply the newly developed LIPT encoding method along with BZIP2 and GZIP to compress text. The NCTCSys selection algorithm decides on the best compression method. To share a common encoding/decoding dictionary between the client and the server we use the dictionary management protocol. In a typical congestion and fluctuating scenario of bandwidth we have reduced transmission times by 60.24% using LIPT+GZIP, and by 85.20% using LIPT+BZIP2.