Package: filearray 0.1.9

filearray: File-Backed Array for Out-of-Memory Computation

Stores large arrays in files to avoid occupying large memories. Implemented with super fast gigabyte-level multi-threaded reading/writing via 'OpenMP'. Supports multiple non-character data types (double, float, complex, integer, logical, and raw).

Authors:Zhengjia Wang [aut, cre, cph]

filearray_0.1.9.tar.gz
filearray_0.1.9.zip(r-4.5)filearray_0.1.9.zip(r-4.4)filearray_0.1.9.zip(r-4.3)
filearray_0.1.9.tgz(r-4.4-x86_64)filearray_0.1.9.tgz(r-4.4-arm64)filearray_0.1.9.tgz(r-4.3-x86_64)filearray_0.1.9.tgz(r-4.3-arm64)
filearray_0.1.9.tar.gz(r-4.5-noble)filearray_0.1.9.tar.gz(r-4.4-noble)
filearray_0.1.9.tgz(r-4.4-emscripten)filearray_0.1.9.tgz(r-4.3-emscripten)
filearray.pdf |filearray.html✨
filearray/json (API)
NEWS

# Install 'filearray' in R:
install.packages('filearray', repos = c('https://dipterix.r-universe.dev', 'https://cloud.r-project.org'))

Peer review:

Bug tracker:https://github.com/dipterix/filearray/issues

Pkgdown site:https://dipterix.org

Uses libs:
  • c++– GNU Standard C++ Library v3

On CRAN:

arraybig-datamemory-mapout-of-memoryoutofmemorycpp

6.49 score 17 stars 3 packages 10 scripts 863 downloads 15 exports 5 dependencies

Last updated 2 months agofrom:5f59eb137a. Checks:OK: 9. Indexed: yes.

TargetResultDate
Doc / VignettesOKDec 08 2024
R-4.5-win-x86_64OKDec 08 2024
R-4.5-linux-x86_64OKDec 08 2024
R-4.4-win-x86_64OKDec 08 2024
R-4.4-mac-x86_64OKDec 08 2024
R-4.4-mac-aarch64OKDec 08 2024
R-4.3-win-x86_64OKDec 08 2024
R-4.3-mac-x86_64OKDec 08 2024
R-4.3-mac-aarch64OKDec 08 2024

Exports:applyas_filearrayas_filearrayproxyfilearray_bindfilearray_checkloadfilearray_createfilearray_loadfilearray_load_or_createfilearray_threadsfmapfmap_element_wisefmap2fwhichmapreducetypeof

Dependencies:BHdigestfastmapRcppuuid

Performance Comparisons - (Numerical)

Rendered fromperformance.Rmdusingknitr::rmarkdownon Dec 08 2024.

Last update: 2024-07-16
Started: 2021-09-08

Readme and manuals

Help Manual

Help pageTopics
Apply functions over file array margins (extended)apply apply,FileArray-method apply,FileArrayProxy-method
Create or load existing file arraysas_filearray as_filearrayproxy filearray FileArrayProxy FileArrayProxy-class filearray_checkload filearray_create filearray_load filearray_load_or_create
Merge and bind homogeneous file arraysfilearray_bind
Set or get file array threadsfilearray_threads
Definition of file arrayFileArray-class
Map multiple file arrays and save resultsfmap fmap2 fmap_element_wise
A generic function of 'which' that is ''FileArray'' compatiblefwhich fwhich.default fwhich.FileArray
A map-reduce method to iterate blocks of file-array data with little memory usagemapreduce mapreduce,FileArray,ANY,function-method mapreduce,FileArray,ANY,missing-method mapreduce,FileArray,ANY,NULL-method
'S3' methods for 'FileArray'as.array.FileArray dim.FileArray dimnames.FileArray dimnames<-.FileArray length.FileArray max.FileArray min.FileArray range.FileArray S3-filearray subset.FileArray sum.FileArray [.FileArray [<-.FileArray [[.FileArray
'S4' methods for 'FileArray'!,FileArray-method !=,array,FileArray-method !=,complex,FileArray-method !=,FileArray,array-method !=,FileArray,complex-method !=,FileArray,FileArray-method !=,FileArray,logical-method !=,FileArray,numeric-method !=,logical,FileArray-method !=,numeric,FileArray-method %%,array,FileArray-method %%,complex,FileArray-method %%,FileArray,array-method %%,FileArray,complex-method %%,FileArray,FileArray-method %%,FileArray,logical-method %%,FileArray,numeric-method %%,logical,FileArray-method %%,numeric,FileArray-method %/%,array,FileArray-method %/%,complex,FileArray-method %/%,FileArray,array-method %/%,FileArray,complex-method %/%,FileArray,FileArray-method %/%,FileArray,logical-method %/%,FileArray,numeric-method %/%,logical,FileArray-method %/%,numeric,FileArray-method &,array,FileArray-method &,complex,FileArray-method &,FileArray,array-method &,FileArray,complex-method &,FileArray,FileArray-method &,FileArray,logical-method &,FileArray,numeric-method &,logical,FileArray-method &,numeric,FileArray-method *,array,FileArray-method *,complex,FileArray-method *,FileArray,array-method *,FileArray,complex-method *,FileArray,FileArray-method *,FileArray,logical-method *,FileArray,numeric-method *,logical,FileArray-method *,numeric,FileArray-method +,array,FileArray-method +,complex,FileArray-method +,FileArray,array-method +,FileArray,complex-method +,FileArray,FileArray-method +,FileArray,logical-method +,FileArray,numeric-method +,logical,FileArray-method +,numeric,FileArray-method -,array,FileArray-method -,complex,FileArray-method -,FileArray,array-method -,FileArray,complex-method -,FileArray,FileArray-method -,FileArray,logical-method -,FileArray,numeric-method -,logical,FileArray-method -,numeric,FileArray-method /,array,FileArray-method /,complex,FileArray-method /,FileArray,array-method /,FileArray,complex-method /,FileArray,FileArray-method /,FileArray,logical-method /,FileArray,numeric-method /,logical,FileArray-method /,numeric,FileArray-method <,array,FileArray-method <,complex,FileArray-method <,FileArray,array-method <,FileArray,complex-method <,FileArray,FileArray-method <,FileArray,logical-method <,FileArray,numeric-method <,logical,FileArray-method <,numeric,FileArray-method <=,array,FileArray-method <=,complex,FileArray-method <=,FileArray,array-method <=,FileArray,complex-method <=,FileArray,FileArray-method <=,FileArray,logical-method <=,FileArray,numeric-method <=,logical,FileArray-method <=,numeric,FileArray-method ==,array,FileArray-method ==,complex,FileArray-method ==,FileArray,array-method ==,FileArray,complex-method ==,FileArray,FileArray-method ==,FileArray,logical-method ==,FileArray,numeric-method ==,logical,FileArray-method ==,numeric,FileArray-method >,array,FileArray-method >,complex,FileArray-method >,FileArray,array-method >,FileArray,complex-method >,FileArray,FileArray-method >,FileArray,logical-method >,FileArray,numeric-method >,logical,FileArray-method >,numeric,FileArray-method >=,array,FileArray-method >=,complex,FileArray-method >=,FileArray,array-method >=,FileArray,complex-method >=,FileArray,FileArray-method >=,FileArray,logical-method >=,FileArray,numeric-method >=,logical,FileArray-method >=,numeric,FileArray-method abs,FileArray-method acos,FileArray-method acosh,FileArray-method Arg,FileArray-method asin,FileArray-method asinh,FileArray-method atan,FileArray-method atanh,FileArray-method ceiling,FileArray-method Conj,FileArray-method cos,FileArray-method cosh,FileArray-method cospi,FileArray-method digamma,FileArray-method exp,FileArray-method expm1,FileArray-method floor,FileArray-method gamma,FileArray-method Im,FileArray-method is.na,FileArray-method lgamma,FileArray-method log,FileArray-method log10,FileArray-method log1p,FileArray-method log2,FileArray-method Mod,FileArray-method Re,FileArray-method round,FileArray-method S4-filearray sign,FileArray-method signif,FileArray-method sin,FileArray-method sinh,FileArray-method sinpi,FileArray-method sqrt,FileArray-method tan,FileArray-method tanh,FileArray-method tanpi,FileArray-method trigamma,FileArray-method trunc,FileArray-method ^,array,FileArray-method ^,complex,FileArray-method ^,FileArray,array-method ^,FileArray,complex-method ^,FileArray,FileArray-method ^,FileArray,logical-method ^,FileArray,numeric-method ^,logical,FileArray-method ^,numeric,FileArray-method |,array,FileArray-method |,complex,FileArray-method |,FileArray,array-method |,FileArray,complex-method |,FileArray,FileArray-method |,FileArray,logical-method |,FileArray,numeric-method |,logical,FileArray-method |,numeric,FileArray-method
The type of a file array (extended)typeof typeof,FileArray-method typeof,FileArrayProxy-method