Wednesday, 11:30am–1:15pm
Science Centre L4
- Topic
- Introduction
- Reading
- Course Outlines
- Important dates
This course covers how to use deep learning techniques to resolve real-life computational problems involving different kinds of data. We begin with the deep learning problem-solving paradigm: data preparation, model construction, model training, model evaluation, and hyperparameter search. We then study each part of this paradigm in detail.
The course moves from linear regression toward more complex models. To handle structured data, images, text, sequences, signals, and graphs, we cover CNN/ResNet, RNN/LSTM, attention, and GNN models. We also discuss commonly used techniques for handling overfitting and briefly introduce generative models, including VAE and GAN.
Lecturer: Professor LI Yu (liyu@cse.cuhk.edu.hk), SHB-106. Office hours: Friday, 3:00pm–5:00pm.
TA:
Wednesday lecture: 11:30am–1:15pm, Science Centre L4.
Thursday lecture: 4:30pm–5:15pm, T.C. Cheng Bldg C3.
Thursday tutorial: 5:30pm–6:15pm, T.C. Cheng Bldg C3.
ESTR4140 additional Thursday lecture: 3:30pm–4:15pm, T.C. Cheng Bldg C3.
ESTR4140 follows the shared AIST4010 lectures and tutorial above, plus an additional Thursday lecture from 3:30pm to 4:15pm.
Class suspension: No AIST4010 or ESTR4140 lecture or tutorial will be held on Thursday, November 12, due to the CUHK 97th Congregation.
Mainly onsite. Slides will normally be available before each lecture. Online-session information will be posted here when available. Zoom information: Coming soon.
Blackboard is the primary platform for course management and grading. Piazza will be used for class discussion, including anonymous questions. For personal matters, use a private post to the instructor and teaching assistants or contact the teaching team by email.
Piazza details: AIST4010 Piazza.
Bonus (up to 2%): one additional scribing assignment (1%) and course surveys (up to 1%). Register through the Scribing preference sheet. Survey statistics are available here.
The quiz is open book. Detailed arrangements will be announced before the quiz.
Approximately half of the assignment work uses fixed-answer questions and half uses Kaggle competitions. The final Kaggle competition is optional; students who participate receive the highest two scores among the three Kaggle competitions.
The teaching team will provide linear-regression and simple deep-learning baselines. Performance above these baselines maps to the corresponding score bands, with scores interpolated by ranking among the class.
Release dates and deadlines: See the course schedule.
All programming assignments must be completed in Python. We recommend using Google Colab.
Each student should summarize at least one lecture and submit the note within one week of that lecture. Up to five students may sign up for each lecture. Students may take one additional lecture for a 1% bonus. Notes may be posted online; students may choose whether to display their name.
Registration details: Scribing preference sheet.
Projects may be completed individually or in a team. Team projects carry higher expectations and should target publication-quality work. The contribution of each member and the workload split must be defined clearly at the beginning. Discuss serious team projects with Professor Li.
The project consists of proposal (6%), mid-term report (8%), final report (17%), and presentation (17%). The instructor contributes 90% of the project assessment and students contribute 10%.
Each student will have 6 late days to turn in assignments, which can be used on written assignments including A1-written, A2-written, A3-written, project proposal, and project M-report. They cannot be used on Kaggle assignments, the project final report and the scribing note. A maximum of 2 late days can be used for each assignment. Grades will be deducted by 25% for each additional late day. If you would like to use late days for any assignment, please fill in this form before the assignment deadline: Late Day Application.
Deadline for each survey: 11:59pm on the day before the next lecture. We do this because I could have time to answer the questions you mentioned in the survey. Please fill 1 in the Google sheet: Survey results, once you have finished one survey. Usually, we will trust the 1s you fill in the Google sheet. But we will check the things in detail if the number of survey forms we received and the number of 1s on the Google sheet is not consistent.
AI tools may be used to polish project reports. Students must submit both their own version and the AI-polished version, and clearly describe how AI tools were used and which parts were affected. A submission without the student's own version is incomplete.
Materials and notes will be added as they are confirmed. All assignment and project deadlines are at 11:59pm unless otherwise stated. The quiz and project presentations take place during the scheduled class.
| Lec | Date | Section | Time | Location | Topic | Reading | Important dates |
|---|---|---|---|---|---|---|---|
| 1 | Wednesday | LEC 7215 | 11:30am–1:15pm | Science Centre L4 | Introduction | Course Outlines | |
| 2 | Thursday | LEC 7215 | 4:30pm–5:15pm | T.C. Cheng Bldg C3 | ML review | Data mining book, D2L | A0 posted |
| 3 | Wednesday | LEC 7215 | 11:30am–1:15pm | Science Centre L4 | LR/NN | D2L, Universal approximation theorem | |
| 4 | Thursday | LEC 7215 | 4:30pm–5:15pm | T.C. Cheng Bldg C3 | LR/NN and Backpropagation | D2L, Universal approximation theorem, Chain rule, Subgradient | |
| 5 | Wednesday | LEC 7215 | 11:30am–1:15pm | Science Centre L4 | Backpropagation and CNN | D2L, LeNet, AlexNet | |
| 6 | Thursday | LEC 7215 | 4:30pm–5:15pm | T.C. Cheng Bldg C3 | Overfitting | D2L, Augmentation survey, Transfer learning, AlexNet, OOD, Meta-learning | A0 due; A1 posted |
| 7 | Wednesday | LEC 7215 | 11:30am–1:15pm | Science Centre L4 | CNN++ | D2L, DL Bioinformatics | |
| 8 | Wednesday | LEC 7215 | 11:30am–1:15pm | Science Centre L4 | Optimization | Momentum, Adam | |
| 9 | Thursday | LEC 7215 | 4:30pm–5:15pm | T.C. Cheng Bldg C3 | Optimization & Writing | Adam, D2L, Visualization course, Research writing | |
| 10 | Wednesday | LEC 7215 | 11:30am–1:15pm | Science Centre L4 | Loss function | YOLO, Neural style transfer | A1-written due |
| 11 | Thursday | LEC 7215 | 4:30pm–5:15pm | T.C. Cheng Bldg C3 | Text processing | Gensim, NLP datasets | Project proposal due |
| 12 | Wednesday | LEC 7215 | 11:30am–1:15pm | Science Centre L4 | RNN | Text generation, GRUs | A1-Kaggle due; A2 posted |
| 13 | Thursday | LEC 7215 | 4:30pm–5:15pm | T.C. Cheng Bldg C3 | RNN++ | GRUs | |
| 14 | Wednesday | LEC 7215 | 11:30am–1:15pm | Science Centre L4 | RNN++/Attention | Attention, GPT-4 | A2-written due |
| 15 | Thursday | LEC 7215 | 4:30pm–5:15pm | T.C. Cheng Bldg C3 | Attention | Attention, GPT-4, BERT | |
| 16 | Wednesday | LEC 7215 | 11:30am–1:15pm | Science Centre L4 | BERT&GPT | BERT, code | A2-Kaggle due |
| 17 | Thursday | LEC 7215 | 4:30pm–5:15pm | T.C. Cheng Bldg C3 | NLP | Finetune BERT, Text summarization | Project mid-term report due; A3 posted |
| 18 | Wednesday | LEC 7215 | 11:30am–1:15pm | Science Centre L4 | Graph | DeepWalk, node2vec | |
| 19 | Thursday | LEC 7215 | 4:30pm–5:15pm | T.C. Cheng Bldg C3 | No class — CUHK 97th Congregation | ||
| 20 | Wednesday | LEC 7215 | 11:30am–1:15pm | Science Centre L4 | GNN | GCN, GraphSAGE, GAT | |
| 21 | Thursday | LEC 7215 | 4:30pm–5:15pm | T.C. Cheng Bldg C3 | GAN | RL, GAN, Unrolled GAN, Train GAN | |
| 22 | Wednesday | LEC 7215 | 11:30am–1:15pm | Science Centre L4 | Generative | pix2pix, Cycle-GAN, Diffusion models | A3-written due |
| 23 | Thursday | LEC 7215 | 4:30pm–5:15pm | T.C. Cheng Bldg C3 | Summary & Presentation | A3-Kaggle due; Participation Quiz | |
| 24 | Wednesday | LEC 7215 | 11:30am–1:15pm | Science Centre L4 | Project Presentation | Project presentation | |
| 25 | Thursday | LEC 7215 | 4:30pm–5:15pm | T.C. Cheng Bldg C3 | Project Presentation | Project presentation; Project final report due Dec 10 |
Wednesday, 11:30am–1:15pm
Science Centre L4
Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3
Wednesday, 11:30am–1:15pm
Science Centre L4
Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3
Wednesday, 11:30am–1:15pm
Science Centre L4
Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3
Wednesday, 11:30am–1:15pm
Science Centre L4
Wednesday, 11:30am–1:15pm
Science Centre L4
Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3
Wednesday, 11:30am–1:15pm
Science Centre L4
Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3
Wednesday, 11:30am–1:15pm
Science Centre L4
Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3
Wednesday, 11:30am–1:15pm
Science Centre L4
Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3
Wednesday, 11:30am–1:15pm
Science Centre L4
Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3
Wednesday, 11:30am–1:15pm
Science Centre L4
Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3
Wednesday, 11:30am–1:15pm
Science Centre L4
Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3
Wednesday, 11:30am–1:15pm
Science Centre L4
Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3
Wednesday, 11:30am–1:15pm
Science Centre L4
Thursday, 4:30pm–5:15pm
T.C. Cheng Bldg C3
Tutorial topics are listed below. Materials will be released through this page and Blackboard. Tutorial repository: Coming soon.
| TUT | Date | Section | Time | Location | Topic | Materials |
|---|---|---|---|---|---|---|
| 1 | Thursday | T01-TUT 7689 | 5:30pm–6:15pm | T.C. Cheng Bldg C3 | Introduction to Colab, Kaggle, A0 | Materials |
| 2 | Thursday | T01-TUT 7689 | 5:30pm–6:15pm | T.C. Cheng Bldg C3 | PyTorch | Materials |
| 3 | Thursday | T01-TUT 7689 | 5:30pm–6:15pm | T.C. Cheng Bldg C3 | Image Classification Basics | Materials |
| 4 | Thursday | T01-TUT 7689 | 5:30pm–6:15pm | T.C. Cheng Bldg C3 | MLP from Scratch | |
| 5 | Thursday | T01-TUT 7689 | 5:30pm–6:15pm | T.C. Cheng Bldg C3 | CNN components in practice | |
| 6 | Thursday | T01-TUT 7689 | 5:30pm–6:15pm | T.C. Cheng Bldg C3 | Object Detection with YOLO | |
| 7 | Thursday | T01-TUT 7689 | 5:30pm–6:15pm | T.C. Cheng Bldg C3 | A1-Kaggle tutorial | |
| 8 | Thursday | T01-TUT 7689 | 5:30pm–6:15pm | T.C. Cheng Bldg C3 | RNN | |
| 9 | Thursday | T01-TUT 7689 | 5:30pm–6:15pm | T.C. Cheng Bldg C3 | No tutorial — CUHK 97th Congregation | |
| 10 | Thursday | T01-TUT 7689 | 5:30pm–6:15pm | T.C. Cheng Bldg C3 | GNN | |
| 11 | Thursday | T01-TUT 7689 | 5:30pm–6:15pm | T.C. Cheng Bldg C3 | A2-Kaggle&A3-Kaggle tutorial | |
| 12 | Thursday | T01-TUT 7689 | 5:30pm–6:15pm | T.C. Cheng Bldg C3 | TBA |
Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3
Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3
Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3
Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3
Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3
Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3
Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3
Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3
Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3
Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3
Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3
Thursday, 5:30pm–6:15pm
T.C. Cheng Bldg C3