Developer Guide for Intel® Data Analytics Acceleration Library 2018 Update 3

Parametric Rectifier Linear Unit (pReLU) Forward Layer

The forward parametric rectifier linear unit (pReLU) layer computes the function f(x) = max(0, x) + w * min(0, x) for the input argument x, where w is the weight of this argument [HeZhangRenSun].

Problem Statement

Given p-dimensional tensors X and W of size n 1 x n 2 x ... x n p , the problem is to compute the p-dimensional tensor Y = (y i 1 ...i p ) of size n 1 x n 2 x ... x n p such that: