Generative AI and its building blocks

Generative AI and its building blocks

Generative artificial intelligence is experiencing another boom with the emergence of large language models, which play an important role in generating content for chatbots.

2025-06-10

Machine learning Deep learning Foundation model

FM foundation model large model generative AI

What is a large language model, and how does it work?

What is a large language model, and how does it work?

Large language models (LLMs) represent a specialized category of foundation models designed to execute a wide range of natural language processing (NLP) tasks. These models are more advanced and power

2025-06-10

Machine learning Deep learning Foundation model

FM foundation model large model prompt large language model generative AI

What is a foundation model?

What is a foundation model?

A foundation model is a type of artificial intelligence (AI) model that is trained on extensive and varied datasets. It is designed to handle a broad spectrum of general tasks. Serving as a base, thes

2025-06-10

Machine learning Deep learning Foundation model

FM foundation model large model prompt large language model generative AI

Image size vs. image quality vs. image resolution

Image size vs. image quality vs. image resolution

Image size, quality, and resolution are indicator to describe image properties.

2025-03-17

Machine learning Deep learning

quality resolution size

How to implement multi-GPU training with data parallel?

How to implement multi-GPU training with data parallel?

Distributed main function design, data loader design, move model into distributed environment, calculating metrics by gathering results from different GPUs through redution.

2025-03-17

Machine learning Deep learning

DDP parallel multiple gpus

FLOPs and MACs in deep learning

FLOPs and MACs in deep learning

FLOPs and MAcs are used for measuring the computer performance.

2023-06-26

Machine learning Deep learning

FLOPs MACs

Vision transformer: A new way to analyse image

Vision transformer: A new way to analyse image

Vision transformer slices the image into patches and uses self-attention mechanisms (inter-patches) (qkv interaction) to process the features.

2023-05-24

Machine learning Deep learning

attention mechanism transformer ViT vision transformer

Should I contain background class?

Should I contain background class?

The answer is yes Because most deep learning frameworks for segmentation and detection consider background class (classification task does not have a background label).

2023-05-24

Machine learning Deep learning

segmentation detection background class

PhD thinking accumulation 2023

PhD thinking accumulation 2023

魚沫不見影，水紋又如常。

2023-04-11

Lifetalk

PhD

Experiment experience of deep learning and computer vision

Experiment experience of deep learning and computer vision

This blog has been accumulating my network training and testing experience.

2023-03-29

Scientific Research/科研

scientific research 科研 experience