What is a foundation model?

What is a foundation model?

A foundation model is a type of artificial intelligence (AI) model that is trained on extensive and varied datasets. It is designed to handle a broad spectrum of general tasks. Serving as a base, thes

2025-06-10

Machine learning Deep learning Foundation model

FM foundation model large model large language model prompt generative AI

Image size vs. image quality vs. image resolution

Image size vs. image quality vs. image resolution

Image size, quality, and resolution are indicator to describe image properties.

2025-03-17

Machine learning Deep learning

quality resolution size

How to implement multi-GPU training with data parallel?

How to implement multi-GPU training with data parallel?

Distributed main function design, data loader design, move model into distributed environment, calculating metrics by gathering results from different GPUs through redution.

2025-03-17

Machine learning Deep learning

DDP parallel multiple gpus

FLOPs and MACs in deep learning

FLOPs and MACs in deep learning

FLOPs and MAcs are used for measuring the computer performance.

2023-06-26

Machine learning Deep learning

FLOPs MACs

Vision transformer: A new way to analyse image

Vision transformer: A new way to analyse image

Vision transformer slices the image into patches and uses self-attention mechanisms (inter-patches) (qkv interaction) to process the features.

2023-05-24

Machine learning Deep learning

attention mechanism transformer ViT vision transformer

Should I contain background class?

Should I contain background class?

The answer is yes Because most deep learning frameworks for segmentation and detection consider background class (classification task does not have a background label).

2023-05-24

Machine learning Deep learning

segmentation background class detection

PhD thinking accumulation 2023

PhD thinking accumulation 2023

魚沫不見影，水紋又如常。

2023-04-11

Lifetalk

PhD

Experiment experience of deep learning and computer vision

Experiment experience of deep learning and computer vision

This blog has been accumulating my network training and testing experience.

2023-03-29

Scientific Research/科研

scientific research 科研 experience

Good thoughts in 2023

Good thoughts in 2023

There are good thoughts accumulated in 2023.

2023-03-29

Scientific Research/科研

scientific research 科研 thought

Spiking neural network, a bionics way to represent and process data

Spiking neural network, a bionics way to represent and process data

Spiking neural networks are bio-inspired artificial intelligence method to process signal efficiently with low power consumpsion binary signal mechanism.

2023-03-28

Machine learning Deep learning

snn spiking neural network