배치 크기

In the realm of machine learning and particularly deep learning, Batch Size refers to the number of training examples utilized in one iteration of model training. Rather than feeding the entire training data into the neural network at once—which is often computationally impossible due to memory constraints—the dataset is divided into smaller subsets called batches. The model processes one batch, calculates the error, and updates its internal model weights via backpropagation before moving on to the next batch. This hyperparameter plays a pivotal role in determining both the speed of training and the stability of the learning process.

The Dynamics of Training with Batches

The choice of batch size fundamentally alters how the optimization algorithm, typically a variant of stochastic gradient descent, navigates the loss landscape.

• Small Batch Sizes: Using a small number (e.g., 8 or 16) results in "noisy" updates. While the gradient estimation is less accurate for the dataset as a whole, this noise can sometimes help the model escape local minima, potentially leading to better generalization. However, smaller batches require more updates per epoch, which can make training slower in terms of wall-clock time due to overhead.
• Large Batch Sizes: A larger batch (e.g., 128 or 256) provides a more accurate estimate of the gradient, leading to smoother convergence of the loss function. It allows for massive parallelization on modern hardware, significantly speeding up calculation. However, if the batch is too large, the model might settle into sharp, suboptimal minima, leading to overfitting and reduced ability to generalize to new data.

Hardware and Memory Implications

Practitioners must often select a batch size based on hardware limitations rather than purely theoretical preference. Deep learning models, especially large architectures like transformers or advanced convolutional networks, are stored in the VRAM of a GPU.

When utilizing NVIDIA CUDA for acceleration, the VRAM must hold the model parameters, the batch of input data, and the intermediate activation outputs needed for gradient calculation. If the batch size exceeds the available memory, the training will crash with an "Out of Memory" (OOM) error. Techniques like mixed precision training are often employed to reduce memory usage, allowing for larger batch sizes on the same hardware.

관련 개념 구분하기

To configure training effectively, it is essential to distinguish batch size from other temporal terms in the training loop.

• Batch Size vs. Epoch: An epoch represents one complete pass through the entire training dataset. The batch size determines how many chunks the data is split into within that epoch. For example, if you have 1,000 images and a batch size of 100, it will take 10 iterations to complete one epoch.
• Batch Size vs. Iteration: An iteration (or step) is the act of processing one batch and updating the weights. The total number of iterations in training is the number of batches per epoch multiplied by the total number of epochs.
• Batch Size vs. Batch Normalization: While they share a name, Batch Normalization is a specific layer type that normalizes layer inputs based on the mean and variance of the current batch. This technique relies heavily on the batch size; if the batch size is too small (e.g., 2), the statistical estimates become unreliable, potentially degrading performance.

실제 애플리케이션

Adjusting the batch size is a routine necessity when deploying computer vision solutions across various industries.

1. High-Fidelity Medical Imaging: In the field of AI in healthcare, practitioners often work with 3D volumetric data such as MRI or CT scans. These files are incredibly dense and memory-intensive. To perform tasks like medical image analysis or complex image segmentation without crashing the system, engineers often reduce the batch size to a very small number, sometimes even a batch of 1. Here, the priority is processing high-resolution detail rather than raw training speed.
2. Industrial Quality Control: Conversely, in AI in manufacturing, speed is paramount. Automated systems inspecting products on a conveyor belt need to process thousands of images per hour. During inference, engineers might aggregate incoming camera feeds into larger batches to maximize the utilization of edge AI devices, ensuring high throughput for real-time defect detection.

Python에서 배치 크기 설정하기

사용 시 Ultralytics Python 패키지, setting the batch size is straightforward. You can specify a fixed integer or use the dynamic batch=-1 설정, 이는 활용하는 the 자동 배치 기능 하드웨어가 안전하게 처리할 수 있는 최대 배치 크기를 자동으로 계산합니다.

다음 예제는 특정 배치 설정을 사용하여 속도와 정확도 측면에서 최신 표준인 YOLO26 모델을훈련하는 방법을 보여줍니다.

from ultralytics import YOLO

# Load the YOLO26n model (nano version for speed)
model = YOLO("yolo26n.pt")

# Train on the COCO8 dataset
# batch=16 is manually set.
# Alternatively, use batch=-1 for auto-tuning based on available GPU memory.
results = model.train(data="coco8.yaml", epochs=5, batch=16)

For managing large-scale experiments and visualizing how different batch sizes affect your training metrics, tools like the Ultralytics Platform provide a comprehensive environment for logging and comparing runs. Proper hyperparameter tuning of the batch size is often the final step in squeezing the best performance out of your model.