AI Glossary

Every Term, Explained

284 artificial intelligence terms in plain language, from the basics to the advanced. Browse A-Z or by category. Every term opens on its own page at /glossary/term/.

284 terms 11 categories 33 covered in depth on DenebrixAI ★

Browse A-Z — all 284 terms

A

A/B testingDeployment and MLOps

Comparing two versions to see which performs better.

AccountabilityEthics, Safety and Governance

Assigning responsibility for an AI system's actions.

Activation functionDeep Learning and Neural Networks

A function adding non-linearity so networks learn complex patterns.

AdaBoostMachine Learning

Boosts many weak learners into one strong classifier.

AdamDeep Learning and Neural Networks

An adaptive optimiser widely used to train neural networks.

Adversarial attackEthics, Safety and Governance

Inputs crafted to fool a model into errors.

AI agentTools and Platforms

Software that acts toward goals, using tools and memory.

AI auditEthics, Safety and Governance

An independent check of an AI system's risks and compliance.

AI biasEthics, Safety and Governance

Unfair outcomes caused by skewed data or design.

AI ethicsEthics, Safety and Governance

Principles guiding fair and responsible AI use.

AI governanceEthics, Safety and Governance

The rules and processes for overseeing AI systems.

AI regulationEthics, Safety and Governance

Laws and rules governing how AI is built and used.

AI safetyEthics, Safety and Governance

Research into keeping advanced AI systems harmless.

AI winterFoundations

A period when AI funding and interest sharply declined.

AlgorithmMachine Learning

A step-by-step procedure a computer follows to solve a problem.

AlignmentEthics, Safety and Governance

Making AI goals match human values and intentions.

A way for software to request a model's services.

AI that can learn and do any intellectual task humans do.

Software that performs tasks needing human-like intelligence.

Hypothetical AI far smarter than humans in every field.

Attention mechanism ★Deep Learning and Neural Networks

A method letting models focus on the most relevant inputs.

AutoencoderDeep Learning and Neural Networks

A network that compresses input then rebuilds it.

B

BackpropagationDeep Learning and Neural Networks

The method that adjusts weights by sending errors backwards.

Bag of wordsNatural Language Processing

Text as counts of words, ignoring order.

BaggingMachine Learning

Training many models on data samples and averaging them.

BatchTraining and Data

A group of examples processed together in one training step.

Batch normalizationDeep Learning and Neural Networks

Normalising layer inputs to speed up training.

BERTGenerative AI and LLMs

A bidirectional transformer model built for understanding language.

Bias-variance tradeoffMachine Learning

Balancing simple models against overly complex ones.

BoostingMachine Learning

Training models in sequence so each fixes earlier errors.

Bounding boxComputer Vision

A rectangle marking an object's location in an image.

C

Canary deploymentDeployment and MLOps

Releasing a model to a small group first.

CatBoostMachine Learning

A gradient boosting library that handles categorical data well.

Chain-of-thought promptingGenerative AI and LLMs

Asking a model to reason step by step.

ChatbotTools and Platforms

Software that converses with users in text or speech.

ChatGPTGenerative AI and LLMs

OpenAI's conversational AI built on GPT models.

CheckpointTraining and Data

A saved copy of a model during training.

Class imbalanceMachine Learning

When one class has far fewer examples than another.

ClassificationMachine Learning

Predicting which category an example belongs to.

ClaudeGenerative AI and LLMs

Anthropic's family of conversational AI models.

Cloud AIDeployment and MLOps

AI services hosted and run on cloud platforms.

Cloud computing ★Deployment and MLOps

On-demand computing power and storage over the internet.

Systems that mimic human thought to solve complex problems.

Computer vision (CV) ★Computer Vision

AI that lets machines understand images and video.

Confusion matrixMachine Learning

A table showing correct and wrong predictions by class.

ContainerDeployment and MLOps

A package holding code and its dependencies to run anywhere.

Finding images by their visual content, not keywords.

Context windowGenerative AI and LLMs

The amount of text a model can read at once.

Convolutional layerDeep Learning and Neural Networks

A layer that scans input with small filters.

Convolutional neural network (CNN) ★Deep Learning and Neural Networks

A network that learns spatial patterns, mainly in images.

Copyright (AI outputs) ★Ethics, Safety and Governance

Who owns content an AI system generates.

CorpusNatural Language Processing

A large collection of texts used for training or study.

Cross-entropy lossDeep Learning and Neural Networks

A loss that measures how wrong predicted probabilities are.

Cross-validationMachine Learning

Testing a model on different data splits to check reliability.

CUDATools and Platforms

NVIDIA's platform for running code on GPUs.

D

DALL-EGenerative AI and LLMs

OpenAI's model that creates images from text.

Data annotationTraining and Data

Labelling data so models can learn from it.

Data augmentationTraining and Data

Creating extra training examples by modifying existing ones.

Data cleaningTraining and Data

Fixing errors and gaps in data before use.

Data driftTraining and Data

When live data shifts away from training data.

Data governanceEthics, Safety and Governance

Rules for collecting, storing, and using data.

Data leakageMachine Learning

When training data includes information it should not have.

DatasetMachine Learning

A collection of examples used to train or test a model.

DBSCANMachine Learning

Finds dense clusters and marks sparse points as noise.

Decision TreeMachine Learning

Splits data by asking yes/no questions in a tree.

Deep learning (DL) ★Deep Learning and Neural Networks

Machine learning with many-layered neural networks.

DeepfakeEthics, Safety and Governance

Realistic fake media made by AI.

Depth estimationComputer Vision

Guessing how far each part of a scene is.

Diffusion modelGenerative AI and LLMs

A model that creates images by reversing a noising process.

DockerDeployment and MLOps

A tool that builds and runs software in containers.

DropoutDeep Learning and Neural Networks

Randomly switching off neurons during training to prevent overfitting.

E

Early stoppingTraining and Data

Halting training when validation stops improving.

Edge AIDeployment and MLOps

Running AI models on local devices instead of the cloud.

Embedding ★Deep Learning and Neural Networks

A numeric vector that captures the meaning of data.

Ensemble learningMachine Learning

Combining several models for a better prediction.

EntanglementQuantum Computing and AI

Linked qubits sharing one state instantly.

EpochTraining and Data

One full pass through the entire training dataset.

Expert systemFoundations

Software that mimics a human expert using rules and knowledge.

Explainability (XAI)Ethics, Safety and Governance

Making AI decisions understandable to humans.

F

F1 scoreMachine Learning

A balance of precision and recall in one number.

Facial recognitionComputer Vision

Identifying a person from their facial features.

FairnessEthics, Safety and Governance

Treating all groups equitably in AI decisions.

FeatureMachine Learning

A measurable input property a model uses to predict.

Feature engineeringMachine Learning

Creating useful inputs from raw data for a model.

Feature extractionComputer Vision

Pulling useful patterns from raw images.

Feature selectionMachine Learning

Choosing the most useful inputs and dropping the rest.

Few-shot learningGenerative AI and LLMs

Learning a task from only a few examples.

Fine-tuningGenerative AI and LLMs

Further training a pre-trained model for a specific task.

Foundation model ★Generative AI and LLMs

A large general model adapted to many different tasks.

Fully connected layerDeep Learning and Neural Networks

A layer where every neuron links to the next.

G

A model that finds clusters as overlapping bell curves.

GeminiGenerative AI and LLMs

Google's family of multimodal AI models.

Two networks competing, one generating and one judging.

Generative AI ★Generative AI and LLMs

AI that creates new text, images, code, or audio.

GloVeNatural Language Processing

A method that learns word vectors from global word counts.

Google ColabTools and Platforms

A free cloud notebook for running Python and AI code.

A transformer model family pre-trained to generate text.

GPU (Graphics Processing Unit) ★Tools and Platforms

A chip that runs many calculations in parallel.

GradientTraining and Data

The direction and size of change that reduces loss.

Gradient BoostingMachine Learning

Builds trees one by one, each fixing the last one's errors.

Gradient descentDeep Learning and Neural Networks

An optimisation method that reduces errors step by step.

Grid searchMachine Learning

Trying many hyperparameter combinations to find the best.

Ground truthTraining and Data

The correct answers used to judge a model.

GRU (Gated Recurrent Unit)Deep Learning and Neural Networks

A simpler recurrent cell with gates.

H

HallucinationGenerative AI and LLMs

Confident but false output presented as if true.

Hierarchical ClusteringMachine Learning

Builds nested clusters by merging or splitting groups.

Hugging FaceTools and Platforms

A platform sharing pre-trained models, datasets, and tools.

Human-in-the-loopEthics, Safety and Governance

A human reviewing AI decisions before they act.

HyperparameterTraining and Data

A setting chosen before training that controls learning.

I

Image captioningComputer Vision

Writing a sentence that describes an image.

Image classificationComputer Vision

Assigning a label to a whole image.

Image embeddingComputer Vision

A numeric vector representing an image's visual meaning.

Image preprocessingComputer Vision

Cleaning and resizing images before a model reads them.

Image recognition ★Computer Vision

Identifying objects, people, or scenes in images.

Image segmentationComputer Vision

Dividing an image into regions by object or meaning.

In-context learningGenerative AI and LLMs

Learning from examples given in the prompt, without retraining.

Inference ★Training and Data

Using a trained model to make predictions on new input.

Instance segmentationComputer Vision

Labelling each separate object instance in an image.

Software that perceives its environment and acts on it.

Isolation ForestMachine Learning

Detects outliers by isolating unusual points in trees.

J

JailbreakEthics, Safety and Governance

A prompt that tricks a model past its safety rules.

Jupyter NotebookTools and Platforms

An interactive tool for writing and running code.

K

K-Means ClusteringMachine Learning

Groups data into K clusters by nearest centre.

Predicts from the K closest examples in data.

KaggleTools and Platforms

A platform for data science competitions and datasets.

KerasTools and Platforms

A simple high-level library for building neural networks.

Knowledge graphFoundations

A network of facts showing how entities relate to each other.

How knowledge is stored so machines can reason with it.

KubernetesDeployment and MLOps

A system that manages containers at scale.

L

LabelMachine Learning

The correct answer attached to a training example.

LangChainTools and Platforms

A framework for building applications on top of LLMs.

Language modelNatural Language Processing

A model that predicts and generates sequences of words.

Large language model (LLM) ★Generative AI and LLMs

A huge model trained on text to understand and generate language.

Lasso RegressionMachine Learning

Regression that shrinks some coefficients to zero.

LatencyDeployment and MLOps

The delay between a request and a model's response.

LayerDeep Learning and Neural Networks

A group of neurons processing data at one stage.

Learning rateTraining and Data

How big each step is when a model updates its weights.

Learning rate scheduleTraining and Data

A plan that changes the learning rate during training.

LemmatizationNatural Language Processing

Reducing a word to its base dictionary form.

LightGBMMachine Learning

A fast gradient boosting framework built for large datasets.

Finds a line that best separates two classes.

Linear RegressionMachine Learning

Predicts a number by fitting a straight line to data.

LlamaGenerative AI and LLMs

Meta's open family of large language models.

Logistic RegressionMachine Learning

Predicts a yes/no outcome using a logistic curve.

Long short-term memory (LSTM)Deep Learning and Neural Networks

A recurrent network cell that keeps long-term memory.

Loss functionTraining and Data

A measure of how wrong a model's predictions are.

M

Machine learning (ML) ★Machine Learning

Systems that learn patterns from data without explicit programming.

Machine translationNatural Language Processing

Automatically translating text between languages.

MisinformationEthics, Safety and Governance

False information spread without intent to deceive.

Mixture of Experts (MoE)Generative AI and LLMs

A model that routes inputs to specialist sub-models.

MLflowTools and Platforms

A platform for tracking experiments and managing models.

MLOpsDeployment and MLOps

Practices for deploying and maintaining machine learning systems reliably.

Model ★Machine Learning

A trained system that makes predictions from new input data.

Model cardEthics, Safety and Governance

A document describing a model's purpose, limits, and risks.

Model compressionDeployment and MLOps

Reducing a model's size while keeping its accuracy.

Model deploymentDeployment and MLOps

Putting a trained model into production for real users.

Model distillationGenerative AI and LLMs

Compressing a large model into a smaller one.

Model driftDeployment and MLOps

When a live model's accuracy falls as data changes.

Model monitoringDeployment and MLOps

Watching a live model for errors and performance drops.

Model registryDeployment and MLOps

A store that tracks and versions trained models.

Model servingDeployment and MLOps

Making a trained model available for live requests.

Model versioningDeployment and MLOps

Tracking changes to a model over time.

Several AI agents working together toward shared goals.

Multimodal AIGenerative AI and LLMs

AI that works across text, images, audio, and video together.

N

N-gramNatural Language Processing

A sequence of N words treated as one unit.

Naive BayesMachine Learning

Classifies using probabilities, assuming features act independently.

Named entity recognition (NER)Natural Language Processing

Finding names of people, places, and organisations in text.

Narrow AIFoundations

AI built to do one specific task well.

Natural language generation (NLG)Natural Language Processing

The part of NLP focused on producing human-like text.

Natural language processing (NLP)Natural Language Processing

AI that lets computers understand and generate human language.

Natural language understanding (NLU)Natural Language Processing

The part of NLP focused on grasping meaning.

Neural network ★Deep Learning and Neural Networks

Layers of connected nodes that learn patterns from data.

NeuronDeep Learning and Neural Networks

A single unit that takes inputs and produces an output.

NISQQuantum Computing and AI

Near-term quantum computers with limited, noisy qubits.

NumPyTools and Platforms

A Python library for fast numerical arrays.

O

Object detectionComputer Vision

Finding and locating objects inside an image.

ONNXTools and Platforms

An open format for sharing models across frameworks.

OntologyFoundations

A formal map of concepts and their relationships in a domain.

OpenAITools and Platforms

The company behind GPT models and ChatGPT.

OpenCVTools and Platforms

A library for computer vision tasks in code.

Reading text that appears inside images.

Optical flowComputer Vision

Tracking how pixels move between video frames.

OptimizerDeep Learning and Neural Networks

An algorithm that updates weights to reduce loss.

OverfittingMachine Learning

When a model memorises training data and fails on new data.

P

PandasTools and Platforms

A Python library for working with tables of data.

Part-of-speech taggingNatural Language Processing

Labelling each word by its grammatical role.

Perceptual hashing ★Computer Vision

A fingerprint that stays similar for similar-looking images.

Pooling layerDeep Learning and Neural Networks

A layer that shrinks feature maps by summarising regions.

Pose estimationComputer Vision

Finding the positions of body joints in an image.

Post-quantum cryptography ★Quantum Computing and AI

Encryption designed to survive quantum computers.

Pre-trainingTraining and Data

Initial broad training before adapting a model to a task.

PrecisionMachine Learning

The share of predicted positives that are actually correct.

Reduces dimensions while keeping most variation.

PrivacyEthics, Safety and Governance

Protecting personal data from misuse by AI systems.

Prompt ★Generative AI and LLMs

The instruction or question given to an AI model.

Prompt engineeringGenerative AI and LLMs

Crafting inputs to get better outputs from a model.

Prompt injectionEthics, Safety and Governance

Hidden instructions that hijack a model's behaviour.

PyTorchTools and Platforms

Meta's open-source library for building neural networks.

Q

QuantizationDeployment and MLOps

Shrinking a model by using lower-precision numbers.

Quantum advantageQuantum Computing and AI

When a quantum computer solves a useful problem faster.

Quantum annealingQuantum Computing and AI

Solving optimisation problems with quantum tunnelling.

Quantum circuitQuantum Computing and AI

A sequence of gates applied to qubits.

Quantum computing ★Quantum Computing and AI

Computing with quantum bits to solve certain problems faster.

Quantum error correction ★Quantum Computing and AI

Methods that protect qubits from noise and faults.

Quantum gateQuantum Computing and AI

An operation that changes a qubit's state.

Quantum machine learning (QML)Quantum Computing and AI

Machine learning run on quantum computers.

Quantum supremacy ★Quantum Computing and AI

When a quantum computer beats the best classical one.

Qubit ★Quantum Computing and AI

The basic unit of quantum information, holding multiple states.

Question answeringNatural Language Processing

Systems that answer questions from text or knowledge.

R

Random ForestMachine Learning

Many decision trees voting together for a stronger prediction.

Rational agentFoundations

An agent that acts to achieve the best expected outcome.

RecallMachine Learning

The share of actual positives a model correctly finds.

Recurrent neural network (RNN)Deep Learning and Neural Networks

A network that remembers earlier inputs in sequences.

Red teamingEthics, Safety and Governance

Testing a system by attacking it to find weaknesses.

RegressionMachine Learning

Predicting a continuous number from input data.

RegularizationTraining and Data

Techniques that stop a model from overfitting its training data.

Learning by trial, error, and rewards from actions.

ReLUDeep Learning and Neural Networks

An activation that outputs zero below zero and input above.

ResNetDeep Learning and Neural Networks

A deep network using skip connections to train very deep models.

Responsible AIEthics, Safety and Governance

Building and using AI in a fair, safe way.

Grounding answers by retrieving documents before generating.

Reverse image search ★Computer Vision

Searching the web using an image as the query.

Ridge RegressionMachine Learning

Regression that shrinks coefficients to reduce overfitting.

Tuning a model with human-rated responses.

ROC-AUCMachine Learning

A score of how well a model separates two classes.

S

Scikit-learnTools and Platforms

A Python library for classic machine learning algorithms.

Self-attentionDeep Learning and Neural Networks

Attention that lets a sequence weigh its own parts.

Self-supervised learningMachine Learning

Learning by predicting hidden parts of the data itself.

Semantic segmentationComputer Vision

Labelling every pixel by what it shows.

Semi-supervised learningMachine Learning

Learning from a small labelled set plus much unlabelled data.

Sentiment analysisNatural Language Processing

Detecting the feeling or opinion expressed in text.

Shadow deploymentDeployment and MLOps

Running a new model silently beside the live one.

SigmoidDeep Learning and Neural Networks

An activation that squeezes values between zero and one.

SoftmaxDeep Learning and Neural Networks

A function turning scores into probabilities that sum to one.

Speech recognitionNatural Language Processing

Converting spoken words into written text.

Stable DiffusionGenerative AI and LLMs

An open model that generates images from text.

StackingMachine Learning

Combining models by training another model on their outputs.

StemmingNatural Language Processing

Cutting words to their root by removing endings.

Stochastic Gradient Descent (SGD)Deep Learning and Neural Networks

Optimisation using small random data batches.

Stop wordsNatural Language Processing

Common words often removed before text analysis.

Strong AIFoundations

AI with genuine understanding and consciousness like humans.

SuperpositionQuantum Computing and AI

A qubit holding several states at once.

Supervised learningMachine Learning

Learning from labelled examples to predict new outcomes.

Finds the best boundary separating classes in data.

Group behaviour from many simple agents following local rules.

Symbolic AIFoundations

AI that reasons with explicit rules, logic, and symbols.

Synthetic dataTraining and Data

Artificial data created to train or test models.

System promptGenerative AI and LLMs

Hidden instructions that set a model's behaviour.

T

t-SNEMachine Learning

A method that maps high-dimensional data for visualisation.

A hypothetical point when AI surpasses human intelligence.

TemperatureGenerative AI and LLMs

A setting that controls how random a model's output is.

TensorFlowTools and Platforms

Google's open-source library for building machine learning models.

Test setTraining and Data

Held-out data used to measure final model performance.

Text classificationNatural Language Processing

Sorting text into predefined categories.

Text summarizationNatural Language Processing

Shortening a long text while keeping key points.

TF-IDFNatural Language Processing

A score of how important a word is in a document.

ThroughputDeployment and MLOps

How many requests a system handles per unit of time.

Token ★Natural Language Processing

A small text unit, often a word part, that models process.

TokenizationNatural Language Processing

Splitting text into tokens for a model to read.

TPU (Tensor Processing Unit)Tools and Platforms

Google's chip built specially for machine learning.

Train-test splitMachine Learning

Dividing data into training and testing parts.

Training ★Training and Data

Teaching a model by showing it example data.

Training data ★Training and Data

The examples a model learns from.

Transfer learningMachine Learning

Reusing a trained model for a new, related task.

Transformer ★Deep Learning and Neural Networks

A neural architecture built on attention, behind modern LLMs.

TransparencyEthics, Safety and Governance

Openness about how an AI system works and decides.

Turing testFoundations

A test of whether a machine can imitate human conversation convincingly.

U

U-NetDeep Learning and Neural Networks

A network shaped like a U for precise image segmentation.

UnderfittingMachine Learning

When a model is too simple to capture the data patterns.

Unsupervised learningMachine Learning

Finding hidden patterns in data without labelled examples.

V

Validation setTraining and Data

Held-out data used to tune a model during training.

Vanishing gradientDeep Learning and Neural Networks

When gradients shrink and early layers stop learning.

Variational Autoencoder (VAE)Deep Learning and Neural Networks

A generative model learning a smooth latent space.

Vector databaseTools and Platforms

A database storing embeddings for fast similarity search.

Answering questions about an image.

Visual similarity ★Computer Vision

How alike two images look in content and style.

W

Weak AIFoundations

AI that simulates intelligence without real understanding.

Weights and BiasesTools and Platforms

A platform for tracking ML experiments.

WhisperGenerative AI and LLMs

OpenAI's model that turns speech into text.

Word embeddingNatural Language Processing

A vector that captures a word's meaning.

Word2VecNatural Language Processing

A method that learns word vectors from surrounding words.

X

XGBoostMachine Learning

A fast, regularised gradient boosting library for tabular data.

Y

YOLODeep Learning and Neural Networks

A fast object detection system that sees an image once.

Z

Zero-shot learningGenerative AI and LLMs

Handling a task with no examples at all.

Browse by Category — 11 categories

1. Foundations

19 terms

2. Machine Learning

55 terms
AdaBoostBoosts many weak learners into one strong classifier. AlgorithmA step-by-step procedure a computer follows to solve a problem. BaggingTraining many models on data samples and averaging them. Bias-variance tradeoffBalancing simple models against overly complex ones. BoostingTraining models in sequence so each fixes earlier errors. CatBoostA gradient boosting library that handles categorical data well. Class imbalanceWhen one class has far fewer examples than another. ClassificationPredicting which category an example belongs to. Confusion matrixA table showing correct and wrong predictions by class. Cross-validationTesting a model on different data splits to check reliability. Data leakageWhen training data includes information it should not have. DatasetA collection of examples used to train or test a model. DBSCANFinds dense clusters and marks sparse points as noise. Decision TreeSplits data by asking yes/no questions in a tree. Ensemble learningCombining several models for a better prediction. F1 scoreA balance of precision and recall in one number. FeatureA measurable input property a model uses to predict. Feature engineeringCreating useful inputs from raw data for a model. Feature selectionChoosing the most useful inputs and dropping the rest. Gaussian Mixture Model (GMM)A model that finds clusters as overlapping bell curves. Gradient BoostingBuilds trees one by one, each fixing the last one's errors. Grid searchTrying many hyperparameter combinations to find the best. Hierarchical ClusteringBuilds nested clusters by merging or splitting groups. Isolation ForestDetects outliers by isolating unusual points in trees. K-Means ClusteringGroups data into K clusters by nearest centre. K-Nearest Neighbors (KNN)Predicts from the K closest examples in data. LabelThe correct answer attached to a training example. Lasso RegressionRegression that shrinks some coefficients to zero. LightGBMA fast gradient boosting framework built for large datasets. Linear Discriminant Analysis (LDA)Finds a line that best separates two classes. Linear RegressionPredicts a number by fitting a straight line to data. Logistic RegressionPredicts a yes/no outcome using a logistic curve. Machine learning (ML) ★Systems that learn patterns from data without explicit programming. Model ★A trained system that makes predictions from new input data. Naive BayesClassifies using probabilities, assuming features act independently. OverfittingWhen a model memorises training data and fails on new data. PrecisionThe share of predicted positives that are actually correct. Principal Component Analysis (PCA)Reduces dimensions while keeping most variation. Random ForestMany decision trees voting together for a stronger prediction. RecallThe share of actual positives a model correctly finds. RegressionPredicting a continuous number from input data. Reinforcement learning (RL)Learning by trial, error, and rewards from actions. Ridge RegressionRegression that shrinks coefficients to reduce overfitting. ROC-AUCA score of how well a model separates two classes. Self-supervised learningLearning by predicting hidden parts of the data itself. Semi-supervised learningLearning from a small labelled set plus much unlabelled data. StackingCombining models by training another model on their outputs. Supervised learningLearning from labelled examples to predict new outcomes. Support Vector Machine (SVM)Finds the best boundary separating classes in data. t-SNEA method that maps high-dimensional data for visualisation. Train-test splitDividing data into training and testing parts. Transfer learningReusing a trained model for a new, related task. UnderfittingWhen a model is too simple to capture the data patterns. Unsupervised learningFinding hidden patterns in data without labelled examples. XGBoostA fast, regularised gradient boosting library for tabular data.

3. Deep Learning and Neural Networks

33 terms
Activation functionA function adding non-linearity so networks learn complex patterns. AdamAn adaptive optimiser widely used to train neural networks. Attention mechanism ★A method letting models focus on the most relevant inputs. AutoencoderA network that compresses input then rebuilds it. BackpropagationThe method that adjusts weights by sending errors backwards. Batch normalizationNormalising layer inputs to speed up training. Convolutional layerA layer that scans input with small filters. Convolutional neural network (CNN) ★A network that learns spatial patterns, mainly in images. Cross-entropy lossA loss that measures how wrong predicted probabilities are. Deep learning (DL) ★Machine learning with many-layered neural networks. DropoutRandomly switching off neurons during training to prevent overfitting. Embedding ★A numeric vector that captures the meaning of data. Fully connected layerA layer where every neuron links to the next. Gradient descentAn optimisation method that reduces errors step by step. GRU (Gated Recurrent Unit)A simpler recurrent cell with gates. LayerA group of neurons processing data at one stage. Long short-term memory (LSTM)A recurrent network cell that keeps long-term memory. Neural network ★Layers of connected nodes that learn patterns from data. NeuronA single unit that takes inputs and produces an output. OptimizerAn algorithm that updates weights to reduce loss. Pooling layerA layer that shrinks feature maps by summarising regions. Recurrent neural network (RNN)A network that remembers earlier inputs in sequences. ReLUAn activation that outputs zero below zero and input above. ResNetA deep network using skip connections to train very deep models. Self-attentionAttention that lets a sequence weigh its own parts. SigmoidAn activation that squeezes values between zero and one. SoftmaxA function turning scores into probabilities that sum to one. Stochastic Gradient Descent (SGD)Optimisation using small random data batches. Transformer ★A neural architecture built on attention, behind modern LLMs. U-NetA network shaped like a U for precise image segmentation. Vanishing gradientWhen gradients shrink and early layers stop learning. Variational Autoencoder (VAE)A generative model learning a smooth latent space. YOLOA fast object detection system that sees an image once.

4. Natural Language Processing

24 terms
Bag of wordsText as counts of words, ignoring order. CorpusA large collection of texts used for training or study. GloVeA method that learns word vectors from global word counts. Language modelA model that predicts and generates sequences of words. LemmatizationReducing a word to its base dictionary form. Machine translationAutomatically translating text between languages. N-gramA sequence of N words treated as one unit. Named entity recognition (NER)Finding names of people, places, and organisations in text. Natural language generation (NLG)The part of NLP focused on producing human-like text. Natural language processing (NLP)AI that lets computers understand and generate human language. Natural language understanding (NLU)The part of NLP focused on grasping meaning. Part-of-speech taggingLabelling each word by its grammatical role. Question answeringSystems that answer questions from text or knowledge. Sentiment analysisDetecting the feeling or opinion expressed in text. Speech recognitionConverting spoken words into written text. StemmingCutting words to their root by removing endings. Stop wordsCommon words often removed before text analysis. Text classificationSorting text into predefined categories. Text summarizationShortening a long text while keeping key points. TF-IDFA score of how important a word is in a document. Token ★A small text unit, often a word part, that models process. TokenizationSplitting text into tokens for a model to read. Word embeddingA vector that captures a word's meaning. Word2VecA method that learns word vectors from surrounding words.

5. Computer Vision

22 terms
Bounding boxA rectangle marking an object's location in an image. Computer vision (CV) ★AI that lets machines understand images and video. Content-based image retrieval (CBIR) ★Finding images by their visual content, not keywords. Depth estimationGuessing how far each part of a scene is. Facial recognitionIdentifying a person from their facial features. Feature extractionPulling useful patterns from raw images. Image captioningWriting a sentence that describes an image. Image classificationAssigning a label to a whole image. Image embeddingA numeric vector representing an image's visual meaning. Image preprocessingCleaning and resizing images before a model reads them. Image recognition ★Identifying objects, people, or scenes in images. Image segmentationDividing an image into regions by object or meaning. Instance segmentationLabelling each separate object instance in an image. Object detectionFinding and locating objects inside an image. Optical character recognition (OCR) ★Reading text that appears inside images. Optical flowTracking how pixels move between video frames. Perceptual hashing ★A fingerprint that stays similar for similar-looking images. Pose estimationFinding the positions of body joints in an image. Reverse image search ★Searching the web using an image as the query. Semantic segmentationLabelling every pixel by what it shows. Visual question answeringAnswering questions about an image. Visual similarity ★How alike two images look in content and style.

6. Generative AI and LLMs

30 terms
BERTA bidirectional transformer model built for understanding language. Chain-of-thought promptingAsking a model to reason step by step. ChatGPTOpenAI's conversational AI built on GPT models. ClaudeAnthropic's family of conversational AI models. Context windowThe amount of text a model can read at once. DALL-EOpenAI's model that creates images from text. Diffusion modelA model that creates images by reversing a noising process. Few-shot learningLearning a task from only a few examples. Fine-tuningFurther training a pre-trained model for a specific task. Foundation model ★A large general model adapted to many different tasks. GeminiGoogle's family of multimodal AI models. Generative adversarial network (GAN)Two networks competing, one generating and one judging. Generative AI ★AI that creates new text, images, code, or audio. GPT (Generative Pre-trained Transformer)A transformer model family pre-trained to generate text. HallucinationConfident but false output presented as if true. In-context learningLearning from examples given in the prompt, without retraining. Large language model (LLM) ★A huge model trained on text to understand and generate language. LlamaMeta's open family of large language models. Mixture of Experts (MoE)A model that routes inputs to specialist sub-models. Model distillationCompressing a large model into a smaller one. Multimodal AIAI that works across text, images, audio, and video together. Prompt ★The instruction or question given to an AI model. Prompt engineeringCrafting inputs to get better outputs from a model. Retrieval-augmented generation (RAG)Grounding answers by retrieving documents before generating. RLHF (Reinforcement Learning from Human Feedback)Tuning a model with human-rated responses. Stable DiffusionAn open model that generates images from text. System promptHidden instructions that set a model's behaviour. TemperatureA setting that controls how random a model's output is. WhisperOpenAI's model that turns speech into text. Zero-shot learningHandling a task with no examples at all.

7. Training and Data

22 terms

8. Deployment and MLOps

21 terms

9. Ethics, Safety and Governance

23 terms

10. Tools and Platforms

22 terms

11. Quantum Computing and AI

13 terms
No terms match your search. Try a different word.

★ A gold star marks a term DenebrixAI already covers in depth. Those glossary pages link to the site’s existing articles.

DenebrixAI · AI Glossary · /glossary/