Parse files in the ftp tree as utf8, so as not to get random encoding errors
authorMagnus Hagander <magnus@hagander.net>
Mon, 28 Nov 2011 20:14:04 +0000 (21:14 +0100)
committerMagnus Hagander <magnus@hagander.net>
Mon, 28 Nov 2011 20:14:40 +0000 (21:14 +0100)
commit71903d7f0c035e43d43d797b877042e55c1d767a
tree972b74970530cc895b009426e03485fff375dce3
parente712f987ac06668e51d74c005bab18793b09461c
Parse files in the ftp tree as utf8, so as not to get random encoding errors

Any characters that aren't utf-8 will get replaced with the unicode
replacement character, instead of throwing an exception.

Fixes #106
tools/ftp/spider_ftp.py