The compression is unwanted e.g. when i'm scraping on a drive with filesystem compression, or when I want to use a strong compression algo after i'm done scraping.

Is there an option to crawl events out of Facebook?
If not, would it be easy to implement? I could assist if there is interest for that.

After pull request #170 c++ document aligner compilation fails with the following error:

[ 44%] Linking CXX executable bin/ngram_test
/usr/bin/ld: /usr/lib/gcc/x86_64-linux-gnu/9/../../../x86_64-linux-gnu/Scrt1.o: in function `_start':
(.text+0x24): undefined reference to `main'
collect2: error: ld returned 1 exit status
make[2]: *** [CMakeFiles/ngram_test.dir/build.make:163: bin/ngram_t

得到的ip无法爬取网站，我想要爬取wandoujia，但得到的ip访问时timeout

/Users/icst/Desktop/test_proxy/wandoujia/proxyPool/ProxyPoolWorker.py:81: SyntaxWarning: "is not" with a literal. Did you mean "!="?
if proxy is not '':
/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pymysql/cursors.py:170: Warning: (1681, b'Integer display width is deprecated and will be removed in a future release.