Nonlinear inversion of electrical resistivity imaging using pruning Bayesian neural networks
Jiang Fei-Bo1,2, Dai Qian-Wei2, and Dong Li2,3
1. College of Physics and Information Science, Hunan Normal University, Changsha 410081, China.
2. School of Geosciences and Info-Physics, Central South University, Changsha 410083, China.
3. Department of Information Science and Engineering, Hunan International Economics University, Changsha 410205, China.
Abstract Conventional artificial neural networks used to solve electrical resistivity imaging (ERI) inversion problem suffer from overfitting and local minima. To solve these problems, we propose to use a pruning Bayesian neural network (PBNN) nonlinear inversion method and a sample design method based on the K-medoids clustering algorithm. In the sample design method, the training samples of the neural network are designed according to the prior information provided by the K-medoids clustering results; thus, the training process of the neural network is well guided. The proposed PBNN, based on Bayesian regularization, is used to select the hidden layer structure by assessing the effect of each hidden neuron to the inversion results. Then, the hyperparameter αk, which is based on the generalized mean, is chosen to guide the pruning process according to the prior distribution of the training samples under the small-sample condition. The proposed algorithm is more efficient than other common adaptive regularization methods in geophysics. The inversion of synthetic data and field data suggests that the proposed method suppresses the noise in the neural network training stage and enhances the generalization. The inversion results with the proposed method are better than those of the BPNN, RBFNN, and RRBFNN inversion methods as well as the conventional least squares inversion.
This work was supported by the National Natural Science Foundation of China (Grant No. 41374118), the Research Fund for the Higher Education Doctoral Program of China (Grant No. 20120162110015), the China Postdoctoral Science Foundation (Grant No. 2015M580700), the Hunan Provincial Natural Science Foundation, the China (Grant No. 2016JJ3086), the Hunan Provincial Science and Technology Program, China (Grant No. 2015JC3067), the Scientific Research Fund of Hunan Provincial Education Department, China (Grant No. 15B138).
Cite this article:
JIANG Fei-Bo,DAI Qian-Wei,DONG Li. Nonlinear inversion of electrical resistivity imaging using pruning Bayesian neural networks[J]. APPLIED GEOPHYSICS, 2016, 13(2): 267-278.
[1]
Bensaid, A. M., Hall, L. O., Bezdek, J. C., et al., 1996, Validity-guided (re) clustering with applications to image segmentation: Fuzzy Systems, IEEE Transactions on, 4(2), 112−123.
[2]
Calderón-Macías, C., Sen, M. K., and Stoffa, P. L., 2000, Artificial neural networks for parameter estimation in geophysics: Geophysical Prospecting, 48(1), 21−47.
[3]
Chen, S., Chng, E., and Alkadhimi, K., 1996, Regularized orthogonal least squares algorithm for constructing radial basis function networks: International Journal of Control, 64(5), 829−837.
[4]
Chen, X. B., Zao, G. Z., Tang, J., et al., 2005, An adaptive regularized inversion algorithm for magnetotelluric data:Chinese Journal Geophysics, 48(4), 937−946.
[5]
Chen, X., Yu, P., Zhang, L. L., et al., 2011, Adaptive regularized synchronous joint inversion of MT and seismic data: Chinese Journal Geophysics, 54(10), 2673−2681.
[6]
Dai, Q. W., and Jiang, F. B., 2013, Nonlinear inversion for electrical resistivity tomography based on chaotic oscillation PSO-BP algorithm:The Chinese Journal of Nonferrous Metals, 23(10), 2897−2904.
[7]
El-Qady, G., and Ushijima, K., 2001, Inversion of DC resistivity data using neural networks: Geophysical Prospecting, 49(4), 417−430.
[8]
Gribenko, A., and Zhdanov, M., 2007, Rigorous 3D inversion of marine CSEM data based on the integral equation method: Geophysics, 72(2), WA73−WA84.
[9]
Hecht-Nielsen, R., 1988, Neurocomputing: picking the human brain: Spectrum, IEEE, 25(3), 36−41.
[10]
Ho, T. L., 2009, 3-D inversion of borehole-to-surface electrical data using a back-propagation neural network: Journal of Applied Geophysics, 68(4), 489−499.
[11]
Lesur, V., Cuer, M., Straub, A., et al., 1999, 2-D and 3-D interpretation of electrical tomography measurements, Part 2: The inverse problem: Geophysics, 64(2), 396−402.
[12]
Liu, M., Liu, X., Wu, M., et al., 2011, Integrating spectral indices with environmental parameters for estimating heavy metal concentrations in rice using a dynamic fuzzy neural-network model: Computers & Geosciences, 37(10), 1642 −1652.
[13]
Loke, M., and Barker, R., 1995, Least-squares deconvolution of apparent resistivity pseudosections: Geophysics, 60(6), 1682−1690.
[14]
MacKay, D. J., 1992, Bayesian interpolation: Neural computation, 4(3), 415−447.
[15]
Maiti, S., Erram, V. C., Gupta, G., et al., 2012, ANN based inversion of DC resistivity data for groundwater exploration in hard rock terrain of western Maharashtra (India): Journal of Hydrology, 46(4), 294−308.
[16]
Neyamadpour, A., Taib, S., and Wan Abdullah, W. A. T., 2009, Using artificial neural networks to invert 2D DC resistivity imaging data for high resistivity contrast regions: A MATLAB application: Computers & Geosciences, 35(11), 2268−2274.
[17]
Park, H. S., and Jun, C. H., 2009, A simple and fast algorithm for K-medoids clustering: Expert Systems with Applications, 36(2), 3336−3341.
[18]
Pidlisecky, A., and Knight, R., 2008, FW2_5D: A MATLAB 2.5-D electrical resistivity modeling code: Computers & Geosciences, 34(12), 1645−1654.
[19]
Shima, H., 1992, 2-D and 3-D resistivity image reconstruction using crosshole data: Geophysics, 57(10), 1270−1281.
[20]
Srinivas, Y., Raj, A. S., Oliver, D. H., et al., 2012, A robust behavior of Feed Forward Back propagation algorithm of Artificial Neural Networks in the application of vertical electrical sounding data inversion: Geoscience Frontiers, 3(5), 729−736.
[21]
Xu, H. L., and Wu, X. P., 2006, 2_D resistivity inversion using the neural network method:Chinese Journal Geophysics, 49(2), 584−589.
[22]
Zhang, L. Y., and Liu, H. F., 2011, The application of ABP method in high-density resistivity method inversion: Chinese Journal Geophysics, 54(1), 227−233.
2016, Vol. 13 
