AIST4010/ESTR4140: Foundation of Applied Deep Learning — Fall 2026

Course description

This course covers how to use deep learning techniques to resolve real-life computational problems involving different kinds of data. We begin with the deep learning problem-solving paradigm: data preparation, model construction, model training, model evaluation, and hyperparameter search. We then study each part of this paradigm in detail.

The course moves from linear regression toward more complex models. To handle structured data, images, text, sequences, signals, and graphs, we cover CNN/ResNet, RNN/LSTM, attention, and GNN models. We also discuss commonly used techniques for handling overfitting and briefly introduce generative models, including VAE and GAN.

Teaching team

Lecturer: Professor LI Yu (liyu@cse.cuhk.edu.hk), SHB-106. Office hours: Friday, 3:00pm–5:00pm.

TA:

Time and location

Wednesday lecture: 11:30am–1:15pm, Science Centre L4.
Thursday lecture: 4:30pm–5:15pm, T.C. Cheng Bldg C3.
Thursday tutorial: 5:30pm–6:15pm, T.C. Cheng Bldg C3.
ESTR4140 additional Thursday lecture: 3:30pm–4:15pm, T.C. Cheng Bldg C3.

ESTR4140 follows the shared AIST4010 lectures and tutorial above, plus an additional Thursday lecture from 3:30pm to 4:15pm.

Class suspension: No AIST4010 or ESTR4140 lecture or tutorial will be held on Thursday, November 12, due to the CUHK 97th Congregation.

Format

Mainly onsite. Slides will normally be available before each lecture. Online-session information will be posted here when available. Zoom information: Coming soon.

Logistics

Communications

Blackboard is the primary platform for course management and grading. Piazza will be used for class discussion, including anonymous questions. For personal matters, use a private post to the instructor and teaching assistants or contact the teaching team by email.

Piazza details: AIST4010 Piazza.

Grading

Bonus (up to 2%): one additional scribing assignment (1%) and course surveys (up to 1%). Register through the Scribing preference sheet. Survey statistics are available here.

Open-book quiz policy

The quiz is open book. Detailed arrangements will be announced before the quiz.

Assignment policy

Approximately half of the assignment work uses fixed-answer questions and half uses Kaggle competitions. The final Kaggle competition is optional; students who participate receive the highest two scores among the three Kaggle competitions.

The teaching team will provide linear-regression and simple deep-learning baselines. Performance above these baselines maps to the corresponding score bands, with scores interpolated by ranking among the class.

Release dates and deadlines: See the course schedule.

Programming

All programming assignments must be completed in Python. We recommend using Google Colab.

Scribing

Each student should summarize at least one lecture and submit the note within one week of that lecture. Up to five students may sign up for each lecture. Students may take one additional lecture for a 1% bonus. Notes may be posted online; students may choose whether to display their name.

Registration details: Scribing preference sheet.

Projects

Projects may be completed individually or in a team. Team projects carry higher expectations and should target publication-quality work. The contribution of each member and the workload split must be defined clearly at the beginning. Discuss serious team projects with Professor Li.

The project consists of proposal (6%), mid-term report (8%), final report (17%), and presentation (17%). The instructor contributes 90% of the project assessment and students contribute 10%.

Late days

Each student will have 6 late days to turn in assignments, which can be used on written assignments including A1-written, A2-written, A3-written, project proposal, and project M-report. They cannot be used on Kaggle assignments, the project final report and the scribing note. A maximum of 2 late days can be used for each assignment. Grades will be deducted by 25% for each additional late day. If you would like to use late days for any assignment, please fill in this form before the assignment deadline: Late Day Application.

Post-lecture survey

Deadline for each survey: 11:59pm on the day before the next lecture. We do this because I could have time to answer the questions you mentioned in the survey. Please fill 1 in the Google sheet: Survey results, once you have finished one survey. Usually, we will trust the 1s you fill in the Google sheet. But we will check the things in detail if the number of survey forms we received and the number of 1s on the Google sheet is not consistent.

AI tools

AI tools may be used to polish project reports. Students must submit both their own version and the AI-polished version, and clearly describe how AI tools were used and which parts were affected. A submission without the student's own version is incomplete.

Course schedule and materials

Materials and notes will be added as they are confirmed. All assignment and project deadlines are at 11:59pm unless otherwise stated. The quiz and project presentations take place during the scheduled class.

Fall 2026 lecture schedule
Lec Date Section Time Location Topic Reading Important dates
1 Wednesday LEC 7215 11:30am–1:15pm Science Centre L4 Introduction Course Outlines
2 Thursday LEC 7215 4:30pm–5:15pm T.C. Cheng Bldg C3 ML review Data mining book, D2L A0 posted
3 Wednesday LEC 7215 11:30am–1:15pm Science Centre L4 LR/NN D2L, Universal approximation theorem
4 Thursday LEC 7215 4:30pm–5:15pm T.C. Cheng Bldg C3 LR/NN and Backpropagation D2L, Universal approximation theorem, Chain rule, Subgradient
5 Wednesday LEC 7215 11:30am–1:15pm Science Centre L4 Backpropagation and CNN D2L, LeNet, AlexNet
6 Thursday LEC 7215 4:30pm–5:15pm T.C. Cheng Bldg C3 Overfitting D2L, Augmentation survey, Transfer learning, AlexNet, OOD, Meta-learning A0 due; A1 posted
7 Wednesday LEC 7215 11:30am–1:15pm Science Centre L4 CNN++ D2L, DL Bioinformatics
8 Wednesday LEC 7215 11:30am–1:15pm Science Centre L4 Optimization Momentum, Adam
9 Thursday LEC 7215 4:30pm–5:15pm T.C. Cheng Bldg C3 Optimization & Writing Adam, D2L, Visualization course, Research writing
10 Wednesday LEC 7215 11:30am–1:15pm Science Centre L4 Loss function YOLO, Neural style transfer A1-written due
11 Thursday LEC 7215 4:30pm–5:15pm T.C. Cheng Bldg C3 Text processing Gensim, NLP datasets Project proposal due
12 Wednesday LEC 7215 11:30am–1:15pm Science Centre L4 RNN Text generation, GRUs A1-Kaggle due; A2 posted
13 Thursday LEC 7215 4:30pm–5:15pm T.C. Cheng Bldg C3 RNN++ GRUs
14 Wednesday LEC 7215 11:30am–1:15pm Science Centre L4 RNN++/Attention Attention, GPT-4 A2-written due
15 Thursday LEC 7215 4:30pm–5:15pm T.C. Cheng Bldg C3 Attention Attention, GPT-4, BERT
16 Wednesday LEC 7215 11:30am–1:15pm Science Centre L4 BERT&GPT BERT, code A2-Kaggle due
17 Thursday LEC 7215 4:30pm–5:15pm T.C. Cheng Bldg C3 NLP Finetune BERT, Text summarization Project mid-term report due; A3 posted
18 Wednesday LEC 7215 11:30am–1:15pm Science Centre L4 Graph DeepWalk, node2vec
19 Thursday LEC 7215 4:30pm–5:15pm T.C. Cheng Bldg C3 No class — CUHK 97th Congregation
20 Wednesday LEC 7215 11:30am–1:15pm Science Centre L4 GNN GCN, GraphSAGE, GAT
21 Thursday LEC 7215 4:30pm–5:15pm T.C. Cheng Bldg C3 GAN RL, GAN, Unrolled GAN, Train GAN
22 Wednesday LEC 7215 11:30am–1:15pm Science Centre L4 Generative pix2pix, Cycle-GAN, Diffusion models A3-written due
23 Thursday LEC 7215 4:30pm–5:15pm T.C. Cheng Bldg C3 Summary & Presentation A3-Kaggle due; Participation Quiz
24 Wednesday LEC 7215 11:30am–1:15pm Science Centre L4 Project Presentation Project presentation
25 Thursday LEC 7215 4:30pm–5:15pm T.C. Cheng Bldg C3 Project Presentation Project presentation; Project final report due Dec 10
Lecture 1

LEC 7215

Wednesday, 11:30am–1:15pm
Science Centre L4

Important dates
Lecture 7

LEC 7215

Wednesday, 11:30am–1:15pm
Science Centre L4

Topic
CNN++
Important dates
Lecture 8

LEC 7215

Wednesday, 11:30am–1:15pm
Science Centre L4

Topic
Optimization
Reading
Momentum, Adam
Important dates
Lecture 10

LEC 7215

Wednesday, 11:30am–1:15pm
Science Centre L4

Topic
Loss function
Important dates
A1-written due
Lecture 11

LEC 7215

Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3

Topic
Text processing
Important dates
Project proposal due
Lecture 12

LEC 7215

Wednesday, 11:30am–1:15pm
Science Centre L4

Topic
RNN
Important dates
A1-Kaggle due; A2 posted
Lecture 13

LEC 7215

Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3

Topic
RNN++
Reading
GRUs
Important dates
Lecture 14

LEC 7215

Wednesday, 11:30am–1:15pm
Science Centre L4

Topic
RNN++/Attention
Reading
Attention, GPT-4
Important dates
A2-written due
Lecture 15

LEC 7215

Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3

Topic
Attention
Reading
Attention, GPT-4, BERT
Important dates
Lecture 16

LEC 7215

Wednesday, 11:30am–1:15pm
Science Centre L4

Topic
BERT&GPT
Reading
BERT, code
Important dates
A2-Kaggle due
Lecture 17

LEC 7215

Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3

Topic
NLP
Important dates
Project mid-term report due; A3 posted
Lecture 18

LEC 7215

Wednesday, 11:30am–1:15pm
Science Centre L4

Topic
Graph
Reading
DeepWalk, node2vec
Important dates
Lecture 19

LEC 7215

Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3

Topic
No class — CUHK 97th Congregation
Reading
Important dates
Lecture 20

LEC 7215

Wednesday, 11:30am–1:15pm
Science Centre L4

Topic
GNN
Reading
GCN, GraphSAGE, GAT
Important dates
Lecture 21

LEC 7215

Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3

Topic
GAN
Important dates
Lecture 22

LEC 7215

Wednesday, 11:30am–1:15pm
Science Centre L4

Topic
Generative
Important dates
A3-written due
Lecture 23

LEC 7215

Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3

Topic
Summary & Presentation
Reading
Important dates
A3-Kaggle due; Participation Quiz
Lecture 24

LEC 7215

Wednesday, 11:30am–1:15pm
Science Centre L4

Topic
Project Presentation
Reading
Important dates
Project presentation
Lecture 25

LEC 7215

Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3

Topic
Project Presentation
Reading
Important dates
Project presentation; Project final report due Dec 10

Tutorial schedule and materials

Tutorial topics are listed below. Materials will be released through this page and Blackboard. Tutorial repository: Coming soon.

Fall 2026 tutorial schedule
TUT Date Section Time Location Topic Materials
1 Thursday T01-TUT 7689 5:30pm–6:15pm T.C. Cheng Bldg C3 Introduction to Colab, Kaggle, A0 Materials
2 Thursday T01-TUT 7689 5:30pm–6:15pm T.C. Cheng Bldg C3 PyTorch Materials
3 Thursday T01-TUT 7689 5:30pm–6:15pm T.C. Cheng Bldg C3 Image Classification Basics Materials
4 Thursday T01-TUT 7689 5:30pm–6:15pm T.C. Cheng Bldg C3 MLP from Scratch
5 Thursday T01-TUT 7689 5:30pm–6:15pm T.C. Cheng Bldg C3 CNN components in practice
6 Thursday T01-TUT 7689 5:30pm–6:15pm T.C. Cheng Bldg C3 Object Detection with YOLO
7 Thursday T01-TUT 7689 5:30pm–6:15pm T.C. Cheng Bldg C3 A1-Kaggle tutorial
8 Thursday T01-TUT 7689 5:30pm–6:15pm T.C. Cheng Bldg C3 RNN
9 Thursday T01-TUT 7689 5:30pm–6:15pm T.C. Cheng Bldg C3 No tutorial — CUHK 97th Congregation
10 Thursday T01-TUT 7689 5:30pm–6:15pm T.C. Cheng Bldg C3 GNN
11 Thursday T01-TUT 7689 5:30pm–6:15pm T.C. Cheng Bldg C3 A2-Kaggle&A3-Kaggle tutorial
12 Thursday T01-TUT 7689 5:30pm–6:15pm T.C. Cheng Bldg C3 TBA
Tutorial 1

T01-TUT 7689

Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3

Topic
Introduction to Colab, Kaggle, A0
Materials
Materials
Tutorial 2

T01-TUT 7689

Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3

Topic
PyTorch
Materials
Materials
Tutorial 3

T01-TUT 7689

Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3

Topic
Image Classification Basics
Materials
Materials
Tutorial 4

T01-TUT 7689

Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3

Topic
MLP from Scratch
Materials
Tutorial 5

T01-TUT 7689

Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3

Topic
CNN components in practice
Materials
Tutorial 6

T01-TUT 7689

Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3

Topic
Object Detection with YOLO
Materials
Tutorial 7

T01-TUT 7689

Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3

Topic
A1-Kaggle tutorial
Materials
Tutorial 8

T01-TUT 7689

Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3

Topic
RNN
Materials
Tutorial 9

T01-TUT 7689

Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3

Topic
No tutorial — CUHK 97th Congregation
Materials
Tutorial 10

T01-TUT 7689

Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3

Topic
GNN
Materials
Tutorial 11

T01-TUT 7689

Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3

Topic
A2-Kaggle&A3-Kaggle tutorial
Materials
Tutorial 12

T01-TUT 7689

Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3

Topic
TBA
Materials

Assignments