pypipegzip package

Submodules

pypipegzip.pypipegzip module

This module enables working with gunzip to open gzip files

The reason for this module is the following benchmark: - with python gzip decoded to text: $ time ./flipkart_read_all_clickstream.py real 4m23.271s user 55m55.884s sys 1m28.552s - with pipe from zcat: $ time ./flipkart_read_all_clickstream.py real 3m13.042s user 32m49.568s sys 4m0.020s - with pipe from zcat + decoding: $ time ./flipkart_read_all_clickstream.py real 3m19.863s user 32m2.292s sys 4m17.796s

pypipegzip.pypipegzip.zipopen(filename: str, mode: str = 'rb', use_process: bool = False, newline: str | None = None)[source]

pypipegzip.static module

version which can be consumed from within the module

Module contents

Initialize the module