A neural network is a computing system built from many simple units, called nodes or artificial neurons, arranged in connected layers. The name comes from a loose analogy with the brain, and the analogy should be held loosely: an artificial neuron is a small piece of arithmetic, not a biological cell.
It is the architecture underneath essentially all modern AI, from face unlock on your phone to the large language models behind ChatGPT.
The structure
- The input layer receives the raw data. For an image, one node per pixel value. For text, numbers representing each token.
- Hidden layers sit in between and do the work. Each node takes the values from the previous layer, multiplies each by a weight, adds them up, and passes the result through a simple function that decides how strongly to fire.
- The output layer produces the answer: a probability that this is a cat, a predicted price, the next token in a sentence.
Every connection between nodes has a weight, a number expressing how much that input matters. A large network has billions of them. Those weights are the entire content of what the model has learned.
How it learns
The training loop is conceptually simple and repeated an enormous number of times.
- Feed in an example and let it flow forward through the layers to produce a prediction.
- Compare that prediction with the correct answer and measure the error.
- Work backwards through the network, calculating how much each weight contributed to the error. This is backpropagation.
- Nudge every weight slightly in the direction that would have reduced the error.
- Repeat with the next example. Millions of times.
Nobody writes the rules. The rules end up encoded in the weights, distributed across billions of numbers in a form no human can read directly. This is why neural networks are often called black boxes: you can see the output and measure the accuracy, but you cannot open it up and read the reasoning.
What the layers actually learn
For image recognition, the progression is unusually easy to visualise and has been studied directly.
Early layers detect edges and colour gradients. Middle layers combine those into textures, corners and simple shapes. Later layers combine those into recognisable parts: an eye, a wheel, a leaf. The final layers assemble parts into whole objects.
Nobody specified this hierarchy. It emerged from training, because building simple features into complex ones is an efficient way to solve the problem.
Deep learning, and why depth mattered
Deep learning just means a neural network with many hidden layers. The idea is decades old, but it only became practical when three things arrived together: very large labelled datasets, GPUs capable of the necessary parallel arithmetic, and training techniques that stopped very deep networks from failing to learn.
That combination is what produced the step change in image recognition, speech and translation from roughly 2012 onward.
The kinds you will hear about
- Convolutional neural networks (CNNs) for images and video
- Recurrent networks and LSTMs for sequences, largely superseded for language
- Transformers, introduced in 2017, which handle sequences by attending to all positions at once rather than reading strictly left to right. Every major language model today is a transformer, and the attention mechanism is what made them scale.
Practical implications for someone using AI tools
The black box property is real. When a bank's model declines a loan or a fraud system blocks a card, tracing exactly why is genuinely difficult. Regulators in India and elsewhere are increasingly asking for explainability in credit and insurance decisions, and this is the technical reason it is hard.
Neural networks learn correlations, not reasons. A model can be highly accurate and still have latched onto something irrelevant in the training data that happens to correlate with the answer.
They need a great deal of data. Which is why AI performs better on tasks and languages with abundant training data, and noticeably worse on underrepresented Indian languages and local contexts.
Confidence is not accuracy. The output layer produces a probability, and a network can assign high probability to a wrong answer. This is the mechanism underlying hallucination in language models.
Neural networks are one technique within machine learning, which sits within artificial intelligence more broadly.