Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Segfault when reading CSV from within the R environment #55765

Open
Tmonster opened this issue Sep 13, 2024 · 3 comments
Open

Segfault when reading CSV from within the R environment #55765

Tmonster opened this issue Sep 13, 2024 · 3 comments

Comments

@Tmonster
Copy link

Tmonster commented Sep 13, 2024

I am in the process of setting up a new run the the db-benchmark and Julia keeps segfaulting when reading the CSV for the data. Maybe I'm just holding it wrong, but the presence of a segfault and not an error tells me there is an actual bug.

This is the most minimum working example I could make

files needed

julia_segfault.R

system("julia julia_script.jl")

julia_script.jl

#!/usr/bin/env julia

using InMemoryDatasets;
using Printf;
using DLMReader;
using PooledArrays;

x = filereader("small.csv", types=[Characters{5}, Characters{5}, Characters{12}, Int32, Int32, Int32, Int32, Int32, Float64]);

print("done loading...\n"); flush(stdout);

CSV file
small.csv

Command to reproduce and error

$ Rscript julia_segfault.R
Segmentation fault (core dumped)

Originally I thought this could be an R issue, but since the Julia script never finishes, I think the problem is more on the Julia side.

versioninfo()

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
  CPU: 32 × Intel(R) Xeon(R) Platinum 8375C CPU @ 2.90GHz
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
Threads: 40 default, 0 interactive, 20 GC (on 32 virtual cores)
Environment:
  JULIA_HOME = /opt/julia-1.10.5
  JULIA_NUM_THREADS = 40

R sessioninfo()

R version 4.3.3 (2024-02-29)
Platform: x86_64-pc-linux-gnu (64-bit)
Running under: Ubuntu 24.04.1 LTS

Matrix products: default
BLAS:   /usr/lib/x86_64-linux-gnu/blas/libblas.so.3.12.0
LAPACK: /usr/lib/x86_64-linux-gnu/lapack/liblapack.so.3.12.0

locale:
 [1] LC_CTYPE=C.UTF-8       LC_NUMERIC=C           LC_TIME=C.UTF-8
 [4] LC_COLLATE=C.UTF-8     LC_MONETARY=C.UTF-8    LC_MESSAGES=C.UTF-8
 [7] LC_PAPER=C.UTF-8       LC_NAME=C              LC_ADDRESS=C
[10] LC_TELEPHONE=C         LC_MEASUREMENT=C.UTF-8 LC_IDENTIFICATION=C

time zone: Etc/UTC
tzcode source: system (glibc)

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base

loaded via a namespace (and not attached):
[1] compiler_4.3.3

Let me know if you need anymore information, this was reproduced on an aws machine with size c6id.8xlarge

Edit: Added error message

@oscardssmith
Copy link
Member

Do you have any LD_PRELOADS that could be forcing Julia to load incorrect versions of libraries?

@giordano
Copy link
Contributor

Let me know if you need anymore information

For example the full error message, I don't see it anywhere, or am I totally missing it?

@Tmonster
Copy link
Author

Do you have any LD_PRELOADS that could be forcing Julia to load incorrect versions of libraries?

Not too familiar with LD_PRELOADs, so I am going to say no. The aws machine I used was fresh and used fresh installs of the libraries, so I don't think there are any incorrect versions being loaded, unless the libraries I'm using aren't available for 1.10.5.

For example the full error message, I don't see it anywhere, or am I totally missing it?

I forgot to add it, but it isn't very interesting

$ Rscript julia_segfault.R
Segmentation fault (core dumped)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants