Add ML4CV transformer encoder

Browse Source

...

This commit is contained in:

Tian Cheng (Riccardo) Xia

2024-10-03 20:09:34 +02:00

parent 368d88da4a

commit 862e53cbf7

15 changed files with 240 additions and 1 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

BIN

src/year2/machine-learning-for-computer-vision/img/_dot_product_attention.pdf Normal file

Binary file not shown.

BIN

src/year2/machine-learning-for-computer-vision/img/_multi_head_attention.pdf Normal file

Binary file not shown.

BIN

src/year2/machine-learning-for-computer-vision/img/_post_norm_encoder.pdf Normal file

Binary file not shown.

BIN

src/year2/machine-learning-for-computer-vision/img/_pre_norm_encoder.pdf Normal file

Binary file not shown.

BIN

src/year2/machine-learning-for-computer-vision/img/_scaled_dot_attention.pdf Normal file

Binary file not shown.

BIN

src/year2/machine-learning-for-computer-vision/img/_scaled_dot_attention_multi_q.pdf Normal file

Binary file not shown.

BIN

src/year2/machine-learning-for-computer-vision/img/_self_attention.pdf Normal file

Binary file not shown.

BIN

src/year2/machine-learning-for-computer-vision/img/_transformer_autoregressive.pdf Normal file

Binary file not shown.

BIN

src/year2/machine-learning-for-computer-vision/img/_transformer_embeddings.pdf Normal file

Binary file not shown.

BIN

src/year2/machine-learning-for-computer-vision/img/norm_methods.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 492 KiB

BIN

src/year2/machine-learning-for-computer-vision/img/traditional_attention.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 62 KiB

BIN

src/year2/machine-learning-for-computer-vision/img/transformer.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 155 KiB