- unary operations, eg
tanh,log,exp,sigmoid,sqrt,abs,ceil,floor,argmax,argmin - binary operations, eg
pow,mul,add,maximum,minimum,squared_difference - reductions, eg
reduce_sum,reduce_max,reduce_min,reduce_prod,reduce_mean - variables,
tf.Variable - matrix multiplication,
matmul - random numbers, eg
tf.random_uniform,tf.random_normal - softmax, eg
tf.nn.softmax_cross_entropy_with_logits - transformations, eg
tf.split - gradients, automatic differentiation, back-propagation
- trainers, eg
tf.train.AdamOptimizer - ReLU,
tf.nn.relu