- Added scalar support to Ac_mul_B etc. which were causing trouble with expressions like Array'*Scalar.
-
gradloss is added as an alternative to grad. gradloss(f) generates a function that returns a (gradient, result) tuple.
-
gradcheck is added as an alternative gradient checking mechanism. It performs sampling to handle large arrays, and automatically constructs a scalar function to handle array functions.
-
Added gradients for vecnorm, (.!=), (), linearindexing, vec, permutedims, ipermutedims.
-
sum_outgrads{T}(a::AbstractArray{T},b::AbstractArray{T})was not type preserving, now fixed.
-
The word value was being used for too many things. The type Value has been renamed Rec. The field Node.value got renamed to Node.rec.
-
Added reshape to gradients of matmul, unbroadcast etc. Julia array math handles missing rightmost dimensions as 1 so for example rand(1,2)*rand(2) works. Gradients should be careful to preserve the input shape.
-
vcat and hcat are now defined in terms of cat and they should handle arrays of any dimensionality and gradients should preserve the original input shape.
-
getval and fixdomain not exported any more. fixdomain is deprecated. getval should not be necessary because Recs should never be exposed outside AutoGrad.