Package: filearray 0.1.7

filearray: File-Backed Array for Out-of-Memory Computation

Stores large arrays in files to avoid occupying large memories. Implemented with super fast gigabyte-level multi-threaded reading/writing via 'OpenMP'. Supports multiple non-character data types (double, float, complex, integer, logical, and raw).

Authors:Zhengjia Wang [aut, cre, cph]

filearray_0.1.7.tar.gz
filearray_0.1.7.zip(r-4.5)filearray_0.1.7.zip(r-4.4)filearray_0.1.7.zip(r-4.3)
filearray_0.1.7.tgz(r-4.4-arm64)filearray_0.1.7.tgz(r-4.4-x86_64)filearray_0.1.7.tgz(r-4.3-arm64)filearray_0.1.7.tgz(r-4.3-x86_64)
filearray_0.1.7.tar.gz(r-4.5-noble)filearray_0.1.7.tar.gz(r-4.4-noble)
filearray_0.1.7.tgz(r-4.4-emscripten)filearray_0.1.7.tgz(r-4.3-emscripten)
filearray.pdf |filearray.html✨
filearray/json (API)
NEWS

# Install 'filearray' in R:

install.packages('filearray', repos = c('https://dipterix.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://github.com/dipterix/filearray/issues

Uses libs:

c++– GNU Standard C++ Library v3

On CRAN:

array big-data memory-map out-of-memory outofmemory

15 exports 17 stars 2.19 score 5 dependencies 2 dependents 295 downloads

Last updated 10 days agofrom:78b96f1f87

Exports:apply as_filearray as_filearrayproxy filearray_bind filearray_checkload filearray_create filearray_load filearray_load_or_create filearray_threads fmap fmap_element_wise fmap2 fwhich mapreduce typeof

Dependencies:BH digest fastmap Rcpp uuid

Performance Comparisons - (Numerical)

Rendered fromperformance.Rmdusingknitr::rmarkdownon Jul 16 2024.

Last update: 2024-07-16
Started: 2021-09-08

Citation

Development and contributors

Readme and manuals

Help Manual

Help page	Topics
Apply functions over file array margins (extended)	apply apply,FileArray-method apply,FileArrayProxy-method
Create or load existing file arrays	as_filearray as_filearrayproxy filearray FileArrayProxy FileArrayProxy-class filearray_checkload filearray_create filearray_load filearray_load_or_create
Merge and bind homogeneous file arrays	filearray_bind
Set or get file array threads	filearray_threads
Definition of file array	FileArray-class
Map multiple file arrays and save results	fmap fmap2 fmap_element_wise
A generic function of 'which' that is ''FileArray'' compatible	fwhich fwhich.default fwhich.FileArray
A map-reduce method to iterate blocks of file-array data with little memory usage	mapreduce mapreduce,FileArray,ANY,function-method mapreduce,FileArray,ANY,missing-method mapreduce,FileArray,ANY,NULL-method
'S3' methods for 'FileArray'	as.array.FileArray dim.FileArray dimnames.FileArray dimnames<-.FileArray length.FileArray max.FileArray min.FileArray range.FileArray S3-filearray subset.FileArray sum.FileArray [.FileArray [<-.FileArray [[.FileArray
'S4' methods for 'FileArray'	!,FileArray-method !=,array,FileArray-method !=,complex,FileArray-method !=,FileArray,array-method !=,FileArray,complex-method !=,FileArray,FileArray-method !=,FileArray,logical-method !=,FileArray,numeric-method !=,logical,FileArray-method !=,numeric,FileArray-method %%,array,FileArray-method %%,complex,FileArray-method %%,FileArray,array-method %%,FileArray,complex-method %%,FileArray,FileArray-method %%,FileArray,logical-method %%,FileArray,numeric-method %%,logical,FileArray-method %%,numeric,FileArray-method %/%,array,FileArray-method %/%,complex,FileArray-method %/%,FileArray,array-method %/%,FileArray,complex-method %/%,FileArray,FileArray-method %/%,FileArray,logical-method %/%,FileArray,numeric-method %/%,logical,FileArray-method %/%,numeric,FileArray-method &,array,FileArray-method &,complex,FileArray-method &,FileArray,array-method &,FileArray,complex-method &,FileArray,FileArray-method &,FileArray,logical-method &,FileArray,numeric-method &,logical,FileArray-method &,numeric,FileArray-method ,array,FileArray-method ,complex,FileArray-method ,FileArray,array-method ,FileArray,complex-method ,FileArray,FileArray-method ,FileArray,logical-method ,FileArray,numeric-method ,logical,FileArray-method *,numeric,FileArray-method +,array,FileArray-method +,complex,FileArray-method +,FileArray,array-method +,FileArray,complex-method +,FileArray,FileArray-method +,FileArray,logical-method +,FileArray,numeric-method +,logical,FileArray-method +,numeric,FileArray-method -,array,FileArray-method -,complex,FileArray-method -,FileArray,array-method -,FileArray,complex-method -,FileArray,FileArray-method -,FileArray,logical-method -,FileArray,numeric-method -,logical,FileArray-method -,numeric,FileArray-method /,array,FileArray-method /,complex,FileArray-method /,FileArray,array-method /,FileArray,complex-method /,FileArray,FileArray-method /,FileArray,logical-method /,FileArray,numeric-method /,logical,FileArray-method /,numeric,FileArray-method <,array,FileArray-method <,complex,FileArray-method <,FileArray,array-method <,FileArray,complex-method <,FileArray,FileArray-method <,FileArray,logical-method <,FileArray,numeric-method <,logical,FileArray-method <,numeric,FileArray-method <=,array,FileArray-method <=,complex,FileArray-method <=,FileArray,array-method <=,FileArray,complex-method <=,FileArray,FileArray-method <=,FileArray,logical-method <=,FileArray,numeric-method <=,logical,FileArray-method <=,numeric,FileArray-method ==,array,FileArray-method ==,complex,FileArray-method ==,FileArray,array-method ==,FileArray,complex-method ==,FileArray,FileArray-method ==,FileArray,logical-method ==,FileArray,numeric-method ==,logical,FileArray-method ==,numeric,FileArray-method >,array,FileArray-method >,complex,FileArray-method >,FileArray,array-method >,FileArray,complex-method >,FileArray,FileArray-method >,FileArray,logical-method >,FileArray,numeric-method >,logical,FileArray-method >,numeric,FileArray-method >=,array,FileArray-method >=,complex,FileArray-method >=,FileArray,array-method >=,FileArray,complex-method >=,FileArray,FileArray-method >=,FileArray,logical-method >=,FileArray,numeric-method >=,logical,FileArray-method >=,numeric,FileArray-method abs,FileArray-method acos,FileArray-method acosh,FileArray-method Arg,FileArray-method asin,FileArray-method asinh,FileArray-method atan,FileArray-method atanh,FileArray-method ceiling,FileArray-method Conj,FileArray-method cos,FileArray-method cosh,FileArray-method cospi,FileArray-method digamma,FileArray-method exp,FileArray-method expm1,FileArray-method floor,FileArray-method gamma,FileArray-method Im,FileArray-method is.na,FileArray-method lgamma,FileArray-method log,FileArray-method log10,FileArray-method log1p,FileArray-method log2,FileArray-method Mod,FileArray-method Re,FileArray-method round,FileArray-method S4-filearray sign,FileArray-method signif,FileArray-method sin,FileArray-method sinh,FileArray-method sinpi,FileArray-method sqrt,FileArray-method tan,FileArray-method tanh,FileArray-method tanpi,FileArray-method trigamma,FileArray-method trunc,FileArray-method ^,array,FileArray-method ^,complex,FileArray-method ^,FileArray,array-method ^,FileArray,complex-method ^,FileArray,FileArray-method ^,FileArray,logical-method ^,FileArray,numeric-method ^,logical,FileArray-method ^,numeric,FileArray-method \|,array,FileArray-method \|,complex,FileArray-method \|,FileArray,array-method \|,FileArray,complex-method \|,FileArray,FileArray-method \|,FileArray,logical-method \|,FileArray,numeric-method \|,logical,FileArray-method \|,numeric,FileArray-method
The type of a file array (extended)	typeof typeof,FileArray-method typeof,FileArrayProxy-method