Comments on: Parallel LZO splittable on Hadoop using Cloudera http://blog.chrisgoffinet.com/2009/06/parallel-lzo-splittable-on-hadoop-using-cloudera/ Random thoughts. Wed, 24 Jun 2009 20:28:27 +0000 http://wordpress.org/?v=2.8.4 hourly 1 By: goffinet http://blog.chrisgoffinet.com/2009/06/parallel-lzo-splittable-on-hadoop-using-cloudera/comment-page-1/#comment-5 goffinet Wed, 24 Jun 2009 20:28:27 +0000 http://blog.chrisgoffinet.com/?p=5#comment-5 @Elias Yes you must generate an index for each LZO file. You only have to do this once per file. @Elias

Yes you must generate an index for each LZO file. You only have to do this once per file.

]]> By: Cloudera Hadoop & Big Data Blog » Blog Archive » Parallel LZO: Splittable Compression for Hadoop http://blog.chrisgoffinet.com/2009/06/parallel-lzo-splittable-on-hadoop-using-cloudera/comment-page-1/#comment-4 Cloudera Hadoop & Big Data Blog » Blog Archive » Parallel LZO: Splittable Compression for Hadoop Wed, 24 Jun 2009 16:52:41 +0000 http://blog.chrisgoffinet.com/?p=5#comment-4 [...] LZO: Splittable Compression for Hadoop Yesterday, Chris Goffinet from Digg made a great blog post about LZO and Hadoop. Many users have been frustrated because LZO has been removed from [...] [...] LZO: Splittable Compression for Hadoop Yesterday, Chris Goffinet from Digg made a great blog post about LZO and Hadoop. Many users have been frustrated because LZO has been removed from [...]

]]> By: Elias Torres http://blog.chrisgoffinet.com/2009/06/parallel-lzo-splittable-on-hadoop-using-cloudera/comment-page-1/#comment-3 Elias Torres Wed, 24 Jun 2009 15:54:21 +0000 http://blog.chrisgoffinet.com/?p=5#comment-3 I don't understand. Do I have to run the Indexer for *every* file I want to mapred over? I don’t understand. Do I have to run the Indexer for *every* file I want to mapred over?

]]> By: 0xABADC0DA http://blog.chrisgoffinet.com/2009/06/parallel-lzo-splittable-on-hadoop-using-cloudera/comment-page-1/#comment-2 0xABADC0DA Wed, 24 Jun 2009 15:35:06 +0000 http://blog.chrisgoffinet.com/?p=5#comment-2 You might want to try liblzf. It's basically the same as LZO only less well tested and maybe a bit slower, but BSD license. You might want to try liblzf. It’s basically the same as LZO only less well tested and maybe a bit slower, but BSD license.

]]>