121 questions
- Bountied 0
- Unanswered
- Frequent
- Score
- Trending
- Week
- Month
- Unanswered (my tags)
0
votes
1
answer
53
views
How to read LZO compressed pandas HDF5 files?
Here is the situation: I have data saved into pandas HDF5 files. Some data is compressed using lzo and some using blosc:zstd. Under RHEL-7, I was able to read both types of files. Then, I was ...
0
votes
1
answer
464
views
How to decompress LZO file using java (using library lzo-core)
I am getting the issue while trying to decompress the LZO file using java. Below is the code and error I have pasted, can someone please help me on this
import org.anarres.lzo.*;
...
1
vote
0
answers
605
views
How to read LZO compressed files in Pyspark
I am using PySpark 3.1.2 with virtual environment.
I am trying to read files compressed with lzo but i cant find proper documentation on how to do that, i understand that for licensing issue, the lzo ...
0
votes
1
answer
127
views
Compression Algorithms with Constant-Time Seek to Specific Byte?
I'm experimenting with building a data-structure optimized for a very specific use-case. Essentially, I am trying to build a compressed bitset of a constant size, and obviously for that use-case, two ...
2
votes
2
answers
2k
views
How to install various compression codecs like LZO and BROTLI on pyspark?
For writing a parquet file and compressing it with LZO codec, I wrote the following code -
df.coalesce(1).write.option("compression","lzo").option("header","true&...
2
votes
1
answer
542
views
using lzo1c_1_compress method in lzo dll
Hi I want to compress a file using lzo in C#
I want to compress it with lzo1c_1_compress but I don't know why its not working at all and make the program crash, here is my code
using System;
using ...
1
vote
0
answers
265
views
Prepraing lzo or lz4 files for Spark
I'm trying to choose the right format for file exchange with my spark application. I use Spark 2.4.7 + Haddop 2.10 on Kubernetess.
My app downloads CSV file from S3 and process it. The file is ...
0
votes
0
answers
811
views
lzop file header structure / reading the uncompressed file size from from the lzo compressed header
I am writing an android application using java in which I need to decompress random lzo compressed files in byte arrays. I am doing that with the https://github.com/shevek/lzo-java library. The ...
1
vote
0
answers
205
views
Decompress LZO indexed files
I need to decompress some lzo indexed files.
First, I've tried to decompress the first lzo file with lzop but in the first line of the fie i have some extra byte.
How I can decompress the file ...
0
votes
1
answer
784
views
How to compress and decompress a string with LZO?
Trying to figure out what the proper way to plug in my data is. Any help? Doing it in the way seen here results in integer without a cast. I've tried this a few ways but never quite got the hand of it....
-1
votes
1
answer
102
views
Empty in define C? [duplicate]
Quick question about the following snippet:
#ifndef __LZO_MMODEL
#define __LZO_MMODEL /*empty*/
#endif
In an empty define like this what does it represent?
It's used in like manner:
#...
0
votes
1
answer
319
views
App crashes while using lzo with the argument -DCMAKE_BUILD_TYPE:STRING=Release on arm-based Android devices
I created an Android project containing c++ code, I use CMake to compile c++ and use JNI to communicate between c++ and Java. In the cpp file, I use miniLZO to compress a file. Here is the code.
...
1
vote
1
answer
437
views
How do I write a LZ compressed string to text file using JXA?
I am trying to write a JXA script in Apple Script Editor, that compresses a string using the LZ algorithm and writes it to a text (JSON) file:
var story = "Once upon a time in Silicon Valley..."
var ...
0
votes
0
answers
260
views
Using LZO function lzo1x_decompress(),but VS reports:Access conflict
I want to decompress data from a file,the code is as follows:
FILE* fp2;
lzo_bytep in;
lzo_bytep out1;
lzo_uint out_len;
lzo_uint file_len;
lzo_uint new_len;
err = fopen_s(&fp2, "file1.txt", "r+")...
1
vote
0
answers
424
views
Reading LZO-compressed csv files in tensorflow
I have a collection of csv files compressed in LZO format that I want to import into TensorFlow. However, if I try to read it as I would read uncompressed file, i.e., using
def parse_csv(line):
...