Package: partools 1.1.6

Norm Matloff

partools: Tools for the 'Parallel' Package

Miscellaneous utilities for parallelizing large computations. Alternative to MapReduce. File splitting and distributed operations such as sort and aggregate. "Software Alchemy" method for parallelizing most statistical methods, presented in N. Matloff, Parallel Computation for Data Science, Chapman and Hall, 2015. Includes a debugging aid.

Authors:Norm Matloff <[email protected]> [cre,aut], Clark Fitzgerald <[email protected]> [aut], Reed Davis <[email protected]> [aut], Robin Yancey <[email protected]> [aut], Shunxu Huang <[email protected]> [aut], Alex Rumbaugh <[email protected]> [ctb], Hadley Wickham <[email protected]> [ctb]

partools_1.1.6.tar.gz
partools_1.1.6.zip(r-4.5)partools_1.1.6.zip(r-4.4)partools_1.1.6.zip(r-4.3)
partools_1.1.6.tgz(r-4.4-any)partools_1.1.6.tgz(r-4.3-any)
partools_1.1.6.tar.gz(r-4.5-noble)partools_1.1.6.tar.gz(r-4.4-noble)
partools_1.1.6.tgz(r-4.4-emscripten)partools_1.1.6.tgz(r-4.3-emscripten)
partools.pdf |partools.html✨
partools/json (API)

# Install 'partools' in R:
install.packages('partools', repos = c('https://matloff.r-universe.dev', 'https://cloud.r-project.org'))

Peer review:

Bug tracker:https://github.com/matloff/partools/issues

Datasets:
  • newadult - UCI adult income data set, adapted
  • prgeng - Silicon Valley programmers and engineers

On CRAN:

7.51 score 40 stars 3 packages 30 scripts 446 downloads 78 exports 2 dependencies

Last updated 2 years agofrom:14a7a8c701. Checks:OK: 1 ERROR: 6. Indexed: yes.

TargetResultDate
Doc / VignettesOKNov 04 2024
R-4.5-winERRORNov 04 2024
R-4.5-linuxERRORNov 04 2024
R-4.4-winERRORNov 04 2024
R-4.4-macERRORNov 04 2024
R-4.3-winERRORNov 04 2024
R-4.3-macERRORNov 04 2024

Exports:addlistscacaaggcabasecaclassfitcaclasspredcaglmcakmcaknncalmcameanscaprcompcaquantilecarqdbqdumpdbqloaddbqmsgdbqmsgstartdbqsavedbqviewdbsdfileaggdfilegetrowsdisksortdistribaggdistribcatdistribcountsdistribgetrowsdistribisdtdistribmeansdistribrangedistribsplitdoclscmddocmddTopKValsdwhich.maxdwhich.minexportlibpathsfileaggfilecatfilechunknamefilegetrowsfilereadfilesavefileshufflefilesortfilesplitfilesplitrandfindrowformrowchunksgeteltisgetnumdigsgetPE1getptehqshqsTestipstrcatkilldebuglinecountmakeddfmatrixtolistparpdistpEnvptMEcloseptMEinitptMEinitConsptMEinitSrvrsptMErecvptMEsendptMEtestptMEtestWrkrre_codereadnscramblesetclsinfotryloadpkgvotewritemgrscreenwritewrkrscreens

Dependencies:data.tablepdist

Partools

Rendered frompartools.Rnwusingutils::Sweaveon Nov 04 2024.

Last update: 2020-05-22
Started: 2015-06-23

Readme and manuals

Help Manual

Help pageTopics
Overview and Package Reference Guidepartools-package partools
Software Alchemy: Turning Complex Statistical Computations into Embarrassingly-Parallel Onesca caagg cabase caglm cakm caknn calm cameans caprcomp caquantile carq
Software Alchemy for Machine Learningcaclassfit caclasspred re_code vote
Cut Into Binscutbin
Debugging aid for 'parallel' cluster code.dbqdump dbqload dbqmsg dbqmsgstart dbqsave dbqview dbs killdebug pEnv writemgrscreen writewrkrscreens
Sort File On Diskdisksort streambin
Virtual Data Structuresfindrow makeddf [
Utilities for 'parallel' cluster code.addlists distribagg distribcat distribcounts distribgetrows distribisdt distribmeans distribrange distribsplit doclscmd docmd dwhich.max dwhich.min exportlibpaths formrowchunks geteltis getpte ipstrcat matrixtolist setclsinfo
Distributed Sorthqs hqsTest
UCI adult income data set, adaptednewadult
Partools Appsparpdist
Silicon Valley programmers and engineersprgeng
Message-passing utilities.ptMEclose ptMEinit ptMEinitCons ptMEinitSrvrs ptMErecv ptMEsend ptMEtest ptMEtestWrkr
Snowdoop.dfileagg dfilegetrows dTopKVals fileagg filecat filechunkname filegetrows fileread filesave fileshuffle filesort filesplit filesplitrand getnumdigs linecount readnscramble snowdoop
Sort Bin And Write To Outfilesortbin
Write Chunk Into Binswritechunk