parallelize arrow memcpy and memset operations#5

Open

atumanov wants to merge 214 commits intopcmoritz:masterfrom

atumanov:parallel-arrow-memcpy

Commits on Feb 5, 2016

Initial Commit
jacques-n
committed

Commits on Feb 17, 2016

Commits on Feb 20, 2016

ARROW-5: Update drill-fmpp-maven-plugin to 1.5.0

lw-lin
authored and
jacques-n
committed
ARROW-5: Correct Apache Maven repo for maven plugin use
jacques-n
committed
ARROW-9: Replace straggler references to Drill

lw-lin
authored and
jacques-n
committed

Commits on Mar 1, 2016

ARROW-8: Add .travis.yml and test script for Arrow C++. OS X build fixes
wesm
committed

Commits on Mar 5, 2016

ARROW-24: C++: Implement a logical Table container type
wesm
committed

Commits on Mar 8, 2016

Commits on Mar 16, 2016

ARROW-55: [Python] Fix unit tests in 2.7

danrobinson
authored and
wesm
committed
ARROW-64: Add zsh support to C++ build scripts

xhochy
authored and
wesm
committed

Commits on Mar 17, 2016

ARROW-68: Better error handling for not fully setup systems

emkornfield
authored and
wesm
committed

Commits on Mar 21, 2016

ARROW-73: Support older CMake versions

xhochy
authored and
wesm
committed
ARROW-72: Search for alternative parquet-cpp header

xhochy
authored and
wesm
committed

Commits on Mar 22, 2016

ARROW-28: Adding google's benchmark library to the toolchain

emkornfield
authored and
wesm
committed
ARROW-75: Fix handling of empty strings

danrobinson
authored and
wesm
committed

Commits on Mar 23, 2016

Commits on Mar 24, 2016

ARROW-77: [C++] Conform bitmap interpretation to ARROW-62; 1 for nulls, 0 for non-nulls
wesm
committed

Commits on Mar 25, 2016

Commits on Mar 27, 2016

Commits on Mar 28, 2016

ARROW-30: [Python] Routines for converting between arrow::Array/Table and pandas.DataFrame
wesm
committed
ARROW-80: Handle len call for pre-init arrays

xhochy
authored and
wesm
committed
ARROW-79: [Python] Add benchmarks

xhochy
authored and
wesm
committed
ARROW-88: [C++] Refactor usages of parquet_cpp namespace
wesm
committed
ARROW-83: [C++] Add basic test infrastructure for DecimalType

xhochy
authored and
wesm
committed
ARROW-87: [C++] Add all four possible ways to encode Decimals in Parquet to schema conversion

xhochy
authored and
wesm
committed

Commits on Mar 31, 2016

ARROW-93: Fix builds when using XCode 7.3

danrobinson
authored and
wesm
committed

Commits on Apr 1, 2016

ARROW-89: [Python] Add benchmarks for Arrow<->Pandas conversion

xhochy
authored and
wesm
committed
ARROW-49: [Python] Add Column and Table wrapper interface

xhochy
authored and
wesm
committed
ARROW-90: [C++] Check for SIMD instruction set support

xhochy
authored and
wesm
committed

Commits on Apr 2, 2016

ARROW-71: [C++] Add clang-tidy and clang-format to the the tool chain.

emkornfield
authored and
wesm
committed

Commits on Apr 3, 2016

ARROW-86: [Python] Implement zero-copy Arrow-to-Pandas conversion

xhochy
authored and
wesm
committed

Commits on Apr 11, 2016

ARROW-85: memcmp can be avoided in Equal when comparing with the same …

Kai Zheng
authored and
wesm
committed

Commits on Apr 14, 2016

ARROW-94: [Format] Expand list example to clarify null vs empty list

emkornfield
authored and
wesm
committed

Commits on Apr 17, 2016

ARROW-103: Add files to gitignore

danrobinson
authored and
wesm
committed

Commits on Apr 18, 2016

ARROW-82: Initial IPC support for ListArray

emkornfield
authored and
wesm
committed

Commits on Apr 23, 2016

ARROW-100: [C++] Computing RowBatch size

pcmoritz
authored and
wesm
committed

Commits on Apr 30, 2016

ARROW-104: [FORMAT] Add alignment and padding requirements + union clarification

emkornfield
authored and
wesm
committed

Commits on May 1, 2016

ARROW-92: Arrow to Parquet Schema conversion

xhochy
authored and
wesm
committed

Commits on May 4, 2016

ARROW-188: Add numpy as install requirement

xhochy
authored and
wesm
committed

Commits on May 9, 2016

ARROW-190: Python: Provide installable sdist builds

xhochy
authored and
wesm
committed
ARROW-194: C++: Allow read-only memory mapped source

jihoonson
authored and
wesm
committed
ARROW-193: typos "int his" fix to "in this"

lfzCarlosC
authored and
wesm
committed

Commits on May 10, 2016

ARROW-91: Basic Parquet read support

xhochy
authored and
wesm
committed

Commits on May 15, 2016

ARROW-197: Working first draft of a conda recipe for pyarrow
wesm
committed
ARROW-199: [C++] Refine third party dependency

zhangh43
authored and
wesm
committed

Commits on May 17, 2016

ARROW-185: Make padding and alignment for all buffers be 64 bytes

emkornfield
authored and
wesm
committed

Commits on May 18, 2016

Commits on May 19, 2016

Make BaseValueVector#MAX_ALLOCATION_SIZE configurable

laurentgo
authored and
StevenMPhillips
committed
Fix BaseAllocator.java NPE when assertions are disabled

laurentgo
authored and
StevenMPhillips
committed

Commits on May 20, 2016

Add java support to Travis CI

laurentgo
authored and
StevenMPhillips
committed

Commits on May 23, 2016

ARROW-206: Expose a C++ api to compare ranges of slots between two arrays

emkornfield
authored and
wesm
committed

Commits on Jun 1, 2016

[Doc] Update Layout.md

ebegoli
authored and
wesm
committed

Commits on Jun 3, 2016

ARROW-209: [C++] Triage builds due to unavailable LLVM apt repo
wesm
committed

Commits on Jun 7, 2016

ARROW-211: [Format] Fixed typos in layout examples

Smyatkin-Maxim
authored and
wesm
committed
ARROW-60: [C++] Struct type builder API

fengguangyuan
authored and
wesm
committed

Commits on Jun 8, 2016

ARROW-200: [C++/Python] Return error status on string initialization failure

emkornfield
authored and
wesm
committed
ARROW-212: Change contract of PrimitiveArray to reflect its abstractness

emkornfield
authored and
wesm
committed

Commits on Jun 10, 2016

ARROW-203: Python: Basic filename based Parquet read/write

xhochy
authored and
wesm
committed

Commits on Jun 15, 2016

ARROW-217: Fix Travis w.r.t conda 4.1.0 changes

xhochy
authored and
wesm
committed

Commits on Jun 16, 2016

Commits on Jun 17, 2016

ARROW-219: Preserve CMAKE_CXX_FLAGS, fix compiler warnings
wesm
committed

Commits on Jun 21, 2016

ARROW-223: Do not link against libpython

xhochy
authored and
wesm
committed

Commits on Jun 24, 2016

ARROW-222: Prototyping an IO interface for Arrow, with initial HDFS target
wesm
committed

Commits on Jun 28, 2016

ARROW-215: Support other integer types and strings in Parquet I/O
xhochy
committed

Commits on Jul 1, 2016

ARROW-234: Build libhdfs IO extension in conda artifacts
wesm
committed

Commits on Jul 10, 2016

ARROW-233: Add visibility macros, add static build option
wesm
committed

Commits on Jul 12, 2016

ARROW-237: Implement parquet-cpp's abstract IO interfaces for memory allocation and file reading
wesm
committed

Commits on Jul 13, 2016

ARROW-106: [C++] Add IPC to binary/string types

emkornfield
authored and
wesm
committed

Commits on Jul 18, 2016

Commits on Jul 19, 2016

ARROW-241: Add missing implementation for splitAndTransfer in UnionVector
StevenMPhillips
committed

Commits on Aug 1, 2016

ARROW-244: Some global APIs of IPC module should be visible to the outside

jihoonson
authored and
wesm
committed
ARROW-240: Provide more detailed installation instructions for pyarrow. Closes

MechCoder
authored and
wesm
committed
ARROW-101: Fix java compiler warnings

laurentgo
authored and
wesm
committed

Commits on Aug 3, 2016

ARROW-246: [Java] UnionVector doesn't call allocateNew() when creating it's vectorType

adeneche
authored and
AbdelHakim Deneche
committed

Commits on Aug 4, 2016

ARROW-247: Missing explicit destructor in RowBatchReader causes an incomplete type error

jihoonson
authored and
wesm
committed

Commits on Aug 5, 2016

ARROW-250: Fix for ARROW-246 may cause memory leaks
adeneche
committed

Commits on Aug 12, 2016

Commits on Aug 14, 2016

ARROW-260: Fix flaky oversized tests

jihoonson
authored and
jacques-n
committed

Commits on Aug 15, 2016

ARROW-245: add endianness to RecordBatch
julienledem
committed

Commits on Aug 16, 2016

ARROW-251: Expose APIs for getting code and message of the status

jihoonson
authored and
wesm
committed
ARROW-107: [C++] Implement IPC for structs

emkornfield
authored and
wesm
committed

Commits on Aug 18, 2016

Commits on Aug 19, 2016

ARROW-265: Pad negative decimal values with1
StevenMPhillips
committed

Commits on Aug 22, 2016

ARROW-269: Include typeVector buffers UnionVector.getBuffers()
StevenMPhillips
committed

Commits on Aug 26, 2016

ARROW-264: File format
julienledem
committed

Commits on Aug 28, 2016

ARROW-262: Start metadata specification document
wesm
committed
ARROW-271: Update Field structure to be more explicit

julienledem
authored and
wesm
committed
ARROW-242: Support Timestamp Data Type

xhochy
authored and
wesm
committed

Commits on Aug 29, 2016

ARROW-279: rename vector module to arrow-vector
julienledem
committed

Commits on Sep 6, 2016

ARROW-274: Add NullableMapVector to support nullable maps
julienledem
committed

Commits on Sep 7, 2016

Commits on Sep 8, 2016

ARROW-285: Optional flatc download

laurentgo
authored and
julienledem
committed

Commits on Sep 9, 2016

Commits on Sep 13, 2016

Commits on Sep 16, 2016

Commits on Sep 18, 2016

ARROW-280: [C++] Refactor IPC / memory map IO to use common arrow_io interfaces. Create arrow_ipc leaf library
wesm
committed

Commits on Sep 19, 2016

ARROW-297: Fix Arrow pom for release
julienledem
committed

Commits on Sep 21, 2016

Commits on Sep 25, 2016

ARROW-296: [Python / C++] Remove arrow::parquet, make pyarrow link against parquet_arrow
wesm
committed

Commits on Sep 28, 2016

ARROW-308: UnionListWriter.setPosition() should not call startList()
adeneche
committed

Commits on Sep 29, 2016

ARROW-306: Add option to pass cmake arguments via environment variable

xhochy
authored and
wesm
committed
ARROW-305: Add compression and use_dictionary options to Parquet

xhochy
authored and
wesm
committed

Commits on Sep 30, 2016

ARROW-309: Types.getMinorTypeForArrowType() does not work for Union type
julienledem
committed

Commits on Oct 3, 2016

Commits on Oct 4, 2016

ARROW-302: [C++/Python] Implement C++ IO interfaces for interacting with Python file and bytes objects
wesm
committed
ARROW-313: Build on any version of XCode

Christopher C. Aycock
authored and
julienledem
committed
ARROW-315: finalize timestamp
julienledem
committed

Commits on Oct 5, 2016

ARROW-318: Revise python/README.md given recent changes in codebase

wesm
authored and
julienledem
committed
ARROW-321: fix arrow licenses
julienledem
committed

Commits on Oct 6, 2016

ARROW-320: ComplexCopier.copy(FieldReader, FieldWriter) should not st…

adeneche
authored and
julienledem
committed

Commits on Oct 7, 2016

Commits on Oct 8, 2016

Commits on Oct 11, 2016

Commits on Oct 12, 2016

Commits on Oct 16, 2016

ARROW-191: Python: Provide infrastructure for manylinux1 wheels

xhochy
authored and
wesm
committed
ARROW-336: Run Apache Rat in Travis builds

xhochy
authored and
wesm
committed
ARROW-97: API documentation via sphinx-apidoc

xhochy
authored and
wesm
committed

Commits on Oct 17, 2016

ARROW-261: Refactor String/Binary code paths to reflect unnested (non-list-based) structure
wesm
committed

Commits on Oct 18, 2016

Commits on Oct 21, 2016

ARROW-342: Set Python version on release

xhochy
authored and
wesm
committed

Commits on Oct 26, 2016

ARROW-337: UnionListWriter.list() is doing more than it should, this …

adeneche
authored and
julienledem
committed

Commits on Oct 29, 2016

ARROW-350: Added Kerberos to HDFS client

Christopher C. Aycock
authored and
wesm
committed
ARROW-339: Python 3 compatibility in merge_arrow_pr.py

wesm
authored and
xhochy
committed
ARROW-354: Fix comparison of arrays of empty strings

xhochy
authored and
wesm
committed

Commits on Oct 30, 2016

ARROW-349: Add six as a requirement

hoffmann
authored and
xhochy
committed

Commits on Nov 1, 2016

Commits on Nov 2, 2016

ARROW-358: Add explicit environment variable to locate libhdfs in one's environment

wesm
authored and
xhochy
committed
ARROW-359: Document ARROW_LIBHDFS_DIR

Christopher C. Aycock
authored and
wesm
committed
ARROW-357: Use a single RowGroup for Parquet files as default.

xhochy
authored and
wesm
committed

Commits on Nov 3, 2016

ARROW-323: [Python] Opt-in to pyarrow.parquet extension rather than attempting and failing silently
wesm
committed

Commits on Nov 6, 2016

ARROW-368: Added note for LD_LIBRARY_PATH in Python README

BryanCutler
authored and
xhochy
committed
ARROW-361: Python: Support reading a column-selection from Parquet files

xhochy
authored and
wesm
committed

Commits on Nov 7, 2016

ARROW-362: Fix memory leak in zero-copy arrow to NumPy/pandas conversion
wesm
committed

Commits on Nov 8, 2016

ARROW-312: [Java] IPC file round trip tool for integration testing

julienledem
authored and
wesm
committed

Commits on Nov 9, 2016

ARROW-372: json vector serialization format
julienledem
committed

Commits on Nov 11, 2016

Commits on Nov 16, 2016

ARROW-371: Handle pandas-nullable types correctly

xhochy
authored and
wesm
committed

Commits on Nov 18, 2016

Commits on Nov 19, 2016

implement dense unions
pcmoritz
committed

Commits on Nov 20, 2016

Build arrow_io and arrow_ipc as static libraries.
robertnishihara
committed

Commits on Mar 5, 2017

Commits on Mar 8, 2017

Commits on Mar 9, 2017

Commits on Mar 13, 2017

Commits on Mar 14, 2017

arrow: adding reusable threadpool for parallel memcpy+memset
atumanov
committed