tensorflow图片归一化之tf.layers.batch_normalization/tf.nn.batch_normalization/tf.contrib.layers.batch_norm
2017-08-22 19:11
483 查看
import tensorflow as tf import numpy as np a=np.array([[5.,8.,2.],[7.,9.,1.]]) a=np.expand_dims(a,axis=0) a=tf.constant(a,dtype=tf.float32) a_mean, a_var = tf.nn.moments(a, axes=[0,1],keep_dims=True) b=tf.rsqrt(a_var) c=(a-a_mean)*b d=tf.layers.batch_normalization(a,training=True) e=tf.nn.batch_normalization(a,a_mean,a_var,offset=None,scale=1,variance_epsilon=0) sess = tf.Session() sess.run(tf.global_variables_initializer()) a_value,b_value,c_value,d_value,e_value=sess.run([a,b,c,d,e]) sess.close()
对比:
import tensorflow as tf a=tf.constant([1.,2.,3.,4.,7.,5.,8.,4.,6.],shape=(1,3,3,3)) a_mean, a_var = tf.nn.moments(a, axes=[1,2],keep_dims=True) b=tf.rsqrt(a_var) c=(a-a_mean)*b d=tf.layers.batch_normalization(a,training=True) e=tf.nn.batch_normalization(a,a_mean,a_var,offset=None,scale=1,variance_epsilon=0) f=tf.contrib.layers.batch_norm(a,is_training=True) sess = tf.Session() sess.run(tf.global_variables_initializer()) mean,var=sess.run([a_mean,a_var]) a_value,b_value,c_value,d_value,e_value,f_value=sess.run([a,b,c,d,e,f]) sess.close()
相关文章推荐
- tensorflow学习——tf.layers.batch_normalization/tf.nn.batch_normalization/tf.contrib.layers.batch_norm
- tensorflow 的 Batch Normalization 实现(tf.nn.moments、tf.nn.batch_normalization)
- tensorflow下的局部响应归一化函数tf.nn.lrn
- tf.contrib.layers.dropout和tf.nn.dropout的不同导致的bug
- 【TensorFlow】tf.nn.local_response_normalization详解,lrn正则法如何计算?
- Tensorflow高级API的进阶--利用tf.contrib.learn建立输入函数
- Tensorflow之构建自己的图片数据集TFrecords的方法
- tensorflow中embedding_lookup, tf.gather以及tf.nn.embedding_lookup_sparse的理解
- 深度学习笔记——深度学习框架TensorFlow(四)[高级API tf.contrib.learn]
- 【TensorFlow】tf.nn.conv2d如何实现卷积
- 【TensorFlow】tf.nn.softmax_cross_entropy_with_logits的用法
- 【TensorFlow】TF-tf.nn.dropout
- TensorFlow学习笔记 速记1——tf.nn.dropout
- TensorFlow-4: tf.contrib.learn 快速入门
- tensor flow 学习 tf.contrib.layers.flatten()和tf.contrib.layers.fully_connection()
- tensorflow.layers.batch_normalization使用方法
- tf.nn.conv3d和tf.nn.max_pool3d这两个tensorflow函数的功能和参数
- 【TensorFlow】tf.nn.softmax_cross_entropy_with_logits的用法
- 【Tensorflow】tf.nn.relu函数
- tensorflow-激活函数及tf.nn.dropout