The layers of AI

AI models responds to our inputs (such as text prompts, video or audio files) by providing outputs in turn.

What is invisible to us is the network beneath this exchange, the hidden layer:

!neuralnetwork-AI.png These networks form through a process of iterative computational learning, consisting of petabytes of data, architecting the model and training the model. The larger the model, the more energy it requires for further computations.

There are different kinds of models.

The creation of Large Language Models (a subset of genAI) typically follows:

  1. Pre-training
  2. Fine-tuning the parameters
  3. Reinforcement learning with human feedback