Rasmus Munk Larsen 2f6ddaa25c Add partial vectorization for matrices and tensors of bool. This speeds up boolean operations on Tensors by up to 25x. ...

Benchmark numbers for the logical and of two NxN tensors:

name                                               old time/op             new time/op             delta
BM_booleanAnd_1T/3   [using 1 threads]             14.6ns ± 0%             14.4ns ± 0%   -0.96%
BM_booleanAnd_1T/4   [using 1 threads]             20.5ns ±12%              9.0ns ± 0%  -56.07%
BM_booleanAnd_1T/7   [using 1 threads]             41.7ns ± 0%             10.5ns ± 0%  -74.87%
BM_booleanAnd_1T/8   [using 1 threads]             52.1ns ± 0%             10.1ns ± 0%  -80.59%
BM_booleanAnd_1T/10  [using 1 threads]             76.3ns ± 0%             13.8ns ± 0%  -81.87%
BM_booleanAnd_1T/15  [using 1 threads]              167ns ± 0%               16ns ± 0%  -90.45%
BM_booleanAnd_1T/16  [using 1 threads]              188ns ± 0%               16ns ± 0%  -91.57%
BM_booleanAnd_1T/31  [using 1 threads]              667ns ± 0%               34ns ± 0%  -94.83%
BM_booleanAnd_1T/32  [using 1 threads]              710ns ± 0%               35ns ± 0%  -95.01%
BM_booleanAnd_1T/64  [using 1 threads]             2.80µs ± 0%             0.11µs ± 0%  -95.93%
BM_booleanAnd_1T/128 [using 1 threads]             11.2µs ± 0%              0.4µs ± 0%  -96.11%
BM_booleanAnd_1T/256 [using 1 threads]             44.6µs ± 0%              2.5µs ± 0%  -94.31%
BM_booleanAnd_1T/512 [using 1 threads]              178µs ± 0%               10µs ± 0%  -94.35%
BM_booleanAnd_1T/1k  [using 1 threads]              717µs ± 0%               78µs ± 1%  -89.07%
BM_booleanAnd_1T/2k  [using 1 threads]             2.87ms ± 0%             0.31ms ± 1%  -89.08%
BM_booleanAnd_1T/4k  [using 1 threads]             11.7ms ± 0%              1.9ms ± 4%  -83.55%
BM_booleanAnd_1T/10k [using 1 threads]             70.3ms ± 0%             17.2ms ± 4%  -75.48%

2020-04-20 20:16:28 +00:00

..

arch

Add partial vectorization for matrices and tensors of bool. This speeds up boolean operations on Tensors by up to 25x.

2020-04-20 20:16:28 +00:00

functors

Add partial vectorization for matrices and tensors of bool. This speeds up boolean operations on Tensors by up to 25x.

2020-04-20 20:16:28 +00:00

products

Speed up matrix multiplication for small to medium size matrices by using half- or quarter-packet vectorized loads in gemm_pack_rhs if they have size 4, instead of dropping down the the scalar path.

2020-04-07 22:09:51 +00:00

util

Add numeric_limits min and max for bool

2020-04-06 23:38:57 +00:00

ArithmeticSequence.h

Let doxygen sees lastN

2018-11-09 11:35:48 +01:00

Array.h

Move variadic constructors outside #ifndef EIGEN_PARSED_BY_DOXYGEN block, to make it actually appear in the generated documentation.

2019-07-12 19:46:37 +02:00

ArrayBase.h

Bug #1788: Fix rule-of-three violations inside the stable modules.

2019-12-19 17:30:11 +01:00

ArrayWrapper.h

Fix order of EIGEN_DEVICE_FUNC and returned type

2018-06-28 00:20:59 +02:00

Assign_MKL.h

Fix reserved usage of double __ in macro names

2018-11-23 16:01:47 +01:00

Assign.h

Added missing EIGEN_DEVICE_FUNC

2017-02-28 14:00:15 -08:00

AssignEvaluator.h

bug #1680: improve MSVC inlining by declaring many triavial constructors and accessors as STRONG_INLINE.

2019-02-15 16:35:35 +01:00

BandMatrix.h

…

Block.h

bug #1680: improve MSVC inlining by declaring many triavial constructors and accessors as STRONG_INLINE.

2019-02-15 16:35:35 +01:00

BooleanRedux.h

Added missing EIGEN_DEVICE_FUNC qualifiers

2017-02-28 14:58:45 -08:00

CommaInitializer.h

CommaInitializer wrongfully asserted for 0-sized blocks

2020-04-13 16:41:20 +02:00

ConditionEstimator.h

bug #1635: Use infinity from Numtraits instead of creating it manually.

2018-12-05 15:01:04 +01:00

CoreEvaluators.h

bug #1736: fix compilation issue with A(all,{1,2}).col(j) by implementing true compile-time "if" for block_evaluator<>::coeff(i)/coeffRef(i)

2019-09-11 15:40:07 +02:00

CoreIterators.h

Added += and + operators to inner iterators

2016-12-28 18:29:30 +01:00

CwiseBinaryOp.h

Guard C++11-style default constructor. Also, this is only needed for MSVC

2019-02-16 09:44:05 +01:00

CwiseNullaryOp.h

Build deprecated snippets with -DEIGEN_NO_DEPRECATED_WARNING

2019-07-12 19:43:32 +02:00

CwiseTernaryOp.h

…

CwiseUnaryOp.h

…

CwiseUnaryView.h

Bug #1788: Fix rule-of-three violations inside the stable modules.

2019-12-19 17:30:11 +01:00

DenseBase.h

Bug #1788: Fix rule-of-three violations inside the stable modules.

2019-12-19 17:30:11 +01:00

DenseCoeffsBase.h

Fix doxygen warnings to enable statis code analysis

2019-04-24 12:42:28 -07:00

DenseStorage.h

Rollback or PR-746 and partial rollback of 668ab3fc47

2019-11-05 17:17:58 -08:00

Diagonal.h

bug #1516: add assertion for out-of-range diagonal index in MatrixBase::diagonal(i)

2018-04-03 16:15:43 +02:00

DiagonalMatrix.h

PR 593: Add variadtic ctor for DiagonalMatrix with unit tests

2019-03-14 10:18:24 +01:00

DiagonalProduct.h

Added missing EIGEN_DEVICE_FUNC qualifiers

2017-02-28 14:58:45 -08:00

Dot.h

Adds missing EIGEN_STRONG_INLINE to support MSVC properly inlining small vector calculations

2017-10-26 22:44:28 +02:00

EigenBase.h

Fix doxygen warnings to enable statis code analysis

2019-04-24 12:42:28 -07:00

ForceAlignedAccess.h

…

Fuzzy.h

Added missing EIGEN_DEVICE_FUNC qualifiers

2017-02-28 09:56:45 -08:00

GeneralProduct.h

bug #1680: improve MSVC inlining by declaring many triavial constructors and accessors as STRONG_INLINE.

2019-02-15 16:35:35 +01:00

GenericPacketMath.h

Add partial vectorization for matrices and tensors of bool. This speeds up boolean operations on Tensors by up to 25x.

2020-04-20 20:16:28 +00:00

GlobalFunctions.h

Bug #1785: Introduce numext::rint.

2020-01-07 21:22:44 +00:00

IndexedView.h

Remove some useless const_cast

2019-01-17 18:27:49 +01:00

Inverse.h

Enable CompleteOrthogonalDecomposition::pseudoInverse with non-square fixed-size matrices.

2019-11-13 21:16:53 +01:00

IO.h

IO: Fixed printing of char and unsigned char matrices

2019-12-11 18:22:57 +00:00

Map.h

rollback 374f750ad4

2017-10-12 15:22:10 -04:00

MapBase.h

Bug #1788: Fix rule-of-three violations inside the stable modules.

2019-12-19 17:30:11 +01:00

MathFunctions.h

Add absolute_difference coefficient-wise binary Array function

2020-03-19 17:45:20 +00:00

MathFunctionsImpl.h

Improve accuracy of fast approximate tanh and the logistic functions in Eigen, such that they preserve relative accuracy to within a few ULPs where their function values tend to zero (around x=0 for tanh, and for large negative x for the logistic function).

2019-12-16 21:33:42 +00:00

Matrix.h

Remove {} accidentally added in previous commit

2019-07-18 20:22:17 +02:00

MatrixBase.h

Bug #1788: Fix rule-of-three violations inside the stable modules.

2019-12-19 17:30:11 +01:00

NestByValue.h

Make nestByValue works again (broken since 3.3) and add unit tests.

2019-01-17 18:27:25 +01:00

NoAlias.h

MIsc. source and comment typos

2018-03-11 10:01:44 -04:00

NumTraits.h

Missing struct definition in NumTraits

2020-04-07 09:01:11 -07:00

PartialReduxEvaluator.h

bug #1612: fix regression in "outer-vectorization" of partial reductions for PacketSize==1 (aka complex<double>)

2018-10-16 01:04:25 +02:00

PermutationMatrix.h

bug #1746: Removed implementation of standard copy-constructor and standard copy-assign-operator from PermutationMatrix and Transpositions to allow malloc-less std::move. Added unit-test to rvalue_types

2019-09-24 11:09:58 +02:00

PlainObjectBase.h

Move variadic constructors outside #ifndef EIGEN_PARSED_BY_DOXYGEN block, to make it actually appear in the generated documentation.

2019-07-12 19:46:37 +02:00

Product.h

bug #1680: improve MSVC inlining by declaring many triavial constructors and accessors as STRONG_INLINE.

2019-02-15 16:35:35 +01:00

ProductEvaluators.h

Bug https://gitlab.com/libeigen/eigen/-/issues/1415: add missing EIGEN_DEVICE_FUNC to diagonal_product_evaluator_base.

2020-03-20 13:37:37 +09:00

Random.h

Added missing EIGEN_DEVICE_FUNC qualifiers

2017-02-28 16:42:00 -08:00

Redux.h

bug #1680: improve MSVC inlining by declaring many triavial constructors and accessors as STRONG_INLINE.

2019-02-15 16:35:35 +01:00

Ref.h

Enable construction of Ref<VectorType> from a runtime vector.

2019-03-03 15:25:25 +01:00

Replicate.h

Added missing EIGEN_DEVICE_FUNC qualifiers

2017-02-28 16:42:00 -08:00

Reshaped.h

Add missing EIGEN_DEPRECATED annotations to deprecated functions and fix few other doxygen warnings

2019-04-23 17:23:19 -07:00

ReturnByValue.h

Added missing EIGEN_DEVICE_FUNC qualifiers

2017-02-28 09:56:45 -08:00

Reverse.h

Speed up col/row-wise reverse for fixed size matrices by propagating compile-time sizes.

2019-02-21 22:44:40 +01:00

Select.h

…

SelfAdjointView.h

Add conjugateIf<bool> members to DesneBase, TriangularView, SelfadjointView, and make PartialPivLU use it.

2019-01-17 11:33:43 +01:00

SelfCwiseBinaryOp.h

Fix warning

2018-06-07 15:45:24 +02:00

Solve.h

Remove some useless const_cast

2019-01-17 18:27:49 +01:00

SolverBase.h

Mask unused-parameter warnings, when building with NDEBUG

2019-01-18 10:41:14 +01:00

SolveTriangular.h

bug #1741: fix self-adjoint*matrix, triangular*matrix, and triangular^1*matrix with a destination having a non-trivial inner-stride

2019-09-11 15:04:25 +02:00

StableNorm.h

Make stableNorm and blueNorm compatible with 2D matrices.

2018-04-04 15:13:31 +02:00

StlIterators.h

bug #1776: fix vector-wise STL iterator's operator-> using a proxy as pointer type.

2019-12-03 14:40:15 +01:00

Stride.h

…

Swap.h

bug #1680: improve MSVC inlining by declaring many triavial constructors and accessors as STRONG_INLINE.

2019-02-15 16:35:35 +01:00

Transpose.h

Bug #1788: Fix rule-of-three violations inside the stable modules.

2019-12-19 17:30:11 +01:00

Transpositions.h

bug #1746: Removed implementation of standard copy-constructor and standard copy-assign-operator from PermutationMatrix and Transpositions to allow malloc-less std::move. Added unit-test to rvalue_types

2019-09-24 11:09:58 +02:00

TriangularMatrix.h

Bug #1788: Fix rule-of-three violations inside the stable modules.

2019-12-19 17:30:11 +01:00

VectorBlock.h

bug #1680: improve MSVC inlining by declaring many triavial constructors and accessors as STRONG_INLINE.

2019-02-15 16:35:35 +01:00

VectorwiseOp.h

Update VectorwiseOp.h to allow Plugins similar to MatrixBase.h or ArrayBase.h

2020-03-20 19:30:01 +00:00

Visitor.h

Clean up CUDA/NVCC version macros and their use in Eigen, and a few other CUDA build failures.

2019-05-31 15:26:06 -07:00