Contents
- 7.1 Overview
- 7.2 Linear Regression
- 7.3 Vectors and Matrices
- 7.4 Eigenvalues and Principal Components
- 7.5 Clustering and K-means
- 7.6 Randomness
- 7.6.1 Simple Statistics
- 7.6.2 Distributions and Long-tail Data
- 7.6.3 Least Squares
- 7.6.4 Monte Carlo Techniques
- 7.7 Non-linear Functions for Machine Learning
- 7.7.1 Support Vector Machines
- 7.7.2 Reservoir Computing
- 7.7.3 Kolmogorov-Arnold Networks
- 7.8 Summary
Glossary items referenced in this chapter
activation function, arithmetic mean, asymmetric distribution, B-splines, backpropagation, Byzantine conditions, Cartesian coordinates, centroid, clustering, continuous distribution, correlation matrix, critical point, data reduction, deep neural network, dependent variable, deterministic search, discontinuous, discrete distributions, drunkards walk, eigenvector, feedback phenomena, FPGAs, fully connected, Go, gradient descent, heuristic evaluation function, hill climbing algorithm, hybrid architecture, independent variable, information visualisation, intercept, interquartile range, k-means algorithm, kernel, Kolmogorov-Arnold Networks, Kolmogorov-Arnold representation theorem, least squares, linear discriminant analysis, linear regression, linearly separable, local maximum, long-tail distribution, machine learning, memristor, mode, Monte Carlo techniques, Monte Carlo tree search, multi-layer perceptron, multi-linear regression, neural network, non-linear functions, non-linear transformations, Normal distribution, optimal, outliers, percentiles, perceptron, piecewise linear, pre-whitening, principal components analysis, principal eigenvector, probability, probability density, Python, quartile, randomising the order, readout, regression line, reservoir computing, residuals, search space, search strategies, sigmoid activation function, sigmoid function, similarity matrix, similarity measure, simulated annealing, smoothing, social media, square matrices, standard deviation, statistical techniques, support vector machine, symmetric matrix, time dependence, transpose, uncertainty, uncertainty measure, variance, wavelet