In this paper, a simple wavelet-neuro-system that implements learning ideas based on minimization of empirical risk and oriented on information processing in on-line mode is developed. As an elementary block of such systems, we propose using wavelet-neuron that has improved approximation properties, computational simplicity, high learning rate and capability of local feature identification in data processing. The architecture and learning algorithm for least squares wavelet support machines that are characterized by high speed of operation and possibility of learning under conditions of short training set are proposed.