Supported Operations

TFLite Operations

Neuron SDK supports a wide variety of operations in TFLite. This allows nearly any neural network model to be supported by the specialized compute cores available on most Mediatek devices. Table 1 shows the general data type supported on each device, and Table 2 shows the TFLite operator types which are supported by Neuron SDK on MT8395 of variant data types. The details of the supported operations can be found in the guideline pages.

Table 1

Device

AsymU8

AsymI8

SymI8

SymI16

Fp16

Fp32

Bool8

Int32

MDLA2.0

O

O

O

O

O

VPU

O

O

O

O

O

CPU

O

O

O

O

O

O

Table 2

OP Name

TFLite OP

Ncc-tflite

AsymU8

AsymI8

SymI8

SymI16

Fp16

Fp32

Bool8

Int32

Abs

kTfLiteBuiltinAbs

O

O

O

O

O

O

O

ArgMax

kTfLiteBuiltinArgMax

O

O

O

O

O

ArgMin

kTfLiteBuiltinArgMin

O

O

O

O

O

AvgPooling

kTfLiteBuiltinAveragePool2d

O

O

O

O

O

O

O

Cast

kTfLiteBuiltinCast

O

O

O

O

Concat

kTfLiteBuiltinConcatenation

O

O

O

O

O

O

O

Conv2D

kTfLiteBuiltinConv2d

O

O

O

O

O

O

O

DepthToSpace

kTfLiteBuiltinDepthToSpace

O

O

O

O

O

O

O

DepthwiseConv2D

kTfLiteBuiltinDepthwiseConv2d

O

O

O

O

O

O

O

Dequantize

kTfLiteBuiltinDequantize

O

O

O

O

O

O

O

ElementWiseAdd

kTfLiteBuiltinAdd

O

O

O

O

O

O

O

ElementWiseDiv

kTfLiteBuiltinDiv

O

O

O

O

O

O

O

ElementWiseMul

kTfLiteBuiltinMul

O

O

O

O

O

O

O

ElementWiseSub

kTfLiteBuiltinSub

O

O

O

O

O

O

O

Elu

kTfLiteBuiltinElu

O

O

O

O

O

O

O

Equal

kTfLiteBuiltinEqual

O

O

O

O

O

O

O

FullyConnected

kTfLiteBuiltinFullyConnected

O

O

O

O

O

O

O

Gather

kTfLiteBuiltinGather

O

O

O

Greater

kTfLiteBuiltinGreater

O

O

O

O

O

O

O

GreaterEqual

kTfLiteBuiltinGreaterEqual

O

O

O

O

O

O

O

HardSwish

kTfLiteBuiltinHardSwish

O

O

O

O

O

O

O

L2Norm

kTfLiteBuiltinL2Normalization

O

O

O

O

Less

kTfLiteBuiltinLess

O

O

O

O

O

O

O

LessEqual

kTfLiteBuiltinLessEqual

O

O

O

O

O

O

O

Maximum

kTfLiteBuiltinMaximum

O

O

O

O

O

O

O

MaxPooling

kTfLiteBuiltinMaxPool2d

O

O

O

O

O

O

O

Mean

kTfLiteBuiltinMean

O

O

O

O

O

O

O

Minimum

kTfLiteBuiltinMinimum

O

O

O

O

O

O

O

Neg

kTfLiteBuiltinNeg

O

O

O

O

O

O

O

NotEqual

kTfLiteBuiltinNotEqual

O

O

O

O

O

O

O

Pack

kTfLiteBuiltinPack

O

O

O

O

O

O

Pad

kTfLiteBuiltinPad

O

O

O

O

O

O

O

Pad

kTfLiteBuiltinPadv2

O

O

O

O

O

O

O

Pow

kTfLiteBuiltinPow

O

O

O

O

O

O

PRelu

kTfLiteBuiltinPrelu

O

O

O

O

O

O

O

PRelu

kTfLiteBuiltinLeakyRelu

O

O

O

O

O

O

O

Quantize

kTfLiteBuiltinQuantize

O

O

O

O

O

O

O

ReduceAny

kTfLiteBuiltinReduceAny

O

O

O

ReduceMax

kTfLiteBuiltinReduceMax

O

O

O

ReduceMin

kTfLiteBuiltinReduceMin

O

O

O

ReLU

kTfLiteBuiltinRelu

O

O

O

O

O

O

O

ReLU6

kTfLiteBuiltinRelu6

O

O

O

O

O

O

O

Reshape

kTfLiteBuiltinReshape

O

O

O

O

O

O

O

Reshape

kTfLiteBuiltinSqueeze

O

O

O

O

O

O

O

Resize::BILINEAR

kTfLiteBuiltinResizeBilinear

O

O

O

O

O

O

O

Resize::NEAREST

kTfLiteBuiltinResizeNearestNeighbor

O

O

O

O

O

O

O

RSqrt

kTfLiteBuiltinRsqrt

O

O

O

O

O

O

O

Sigmoid

kTfLiteBuiltinLogistic

O

O

O

O

O

O

O

Slice

kTfLiteBuiltinSlice

O

O

O

O

O

O

SoftMax

kTfLiteBuiltinSoftmax

O

O

O

O

O

O

O

SpaceToDepth

kTfLiteBuiltinSpaceToDepth

O

O

O

O

O

O

O

Split

kTfLiteBuiltinSplit

O

O

O

O

O

O

O

Sqrt

kTfLiteBuiltinSqrt

O

O

O

O

O

O

O

Square

kTfLiteBuiltinSquare

O

O

O

O

O

O

SquaredDifference

kTfLiteBuiltinSquaredDifference

O

O

O

O

O

O

StridedSlice

kTfLiteBuiltinStridedSlice

O

O

O

O

O

O

O

Tanh

kTfLiteBuiltinTanh

O

O

O

O

O

O

O

Tile

kTfLiteBuiltinTile

O

O

O

Transpose

kTfLiteBuiltinTranspose

O

O

O

O

O

O

O

TransposeConv2D

kTfLiteBuiltinTransposeConv

O

O

O

O

O

O

O