[Feature request] Add example of finetuning the pretrained models on custom corpus #30

Activity

1. thomwolf commented on Nov 17, 2018

   

   thomwolf

   on Nov 17, 2018

   Member

   More actions

   Hi I don't plan to add that in the near future but feel free to open a PR if you would like to share an additional example.
2. thomwolf

   closed this as completedon Nov 17, 2018
3. davidefiocco commented on Jan 15, 2019

   

   davidefiocco

   on Jan 15, 2019

   Contributor

   More actions

   Necrobumping this for reference, as this is addressed in https://github.com/huggingface/pytorch-pretrained-BERT/blob/master/examples/run_lm_finetuning.py
4. jameshennessytempus

   added a commit that references this issue on Jun 1, 2023

   Merge pull request huggingface#30 from jamesthesnake/pop

   ...

   34b47e0
5. younesbelkada

   added 2 commits that reference this issue on Feb 23, 2024

   add embed and residual dropout (#30)

   4983a75

   Starcoder2 model - bis (#29215)

   ...

   63caa37
6. ArthurZucker

   added a commit that references this issue on Apr 5, 2025

   Merge pull request #30 from huggingface/fix-causal-lm-loading

   ...

   99f2297
7. VishnuAnand36

   added 3 commits that reference this issue on Jun 25, 2025

   fix(payment): Handle duplicate transaction prevention

   ...

   This issue will close once commit e5e451a is merged into the 'main' branch.

   e5e451a

   fix(payment): Handle duplicate transaction prevention

   ...

   This issue will close once commit 207a18f is merged into the 'main' branch.

   207a18f

   fix(payment): Handle duplicate transaction prevention

   ...

   This issue will close once commit b22f422 is merged into the 'main' branch.

   b22f422
8. RyanMullins

   added a commit that references this issue on Jun 26, 2025

   Gemma 3n

   ...

   79e3735
9. ArthurZucker

   added a commit that references this issue on Jun 26, 2025

   Remove in-place operations (#30)

   ...

   40de575
10. Cyrilvallez

    added a commit that references this issue on Jun 26, 2025

    Gemma 3n (#39059)

    ...

    c63cfd6
11. ArthurZucker

    added a commit that references this issue on Aug 5, 2025

    Merge pull request #30 from huggingface/fix-conversion-architecture

    ...

    e030193
12. zaristei

    added 7 commits that reference this issue on Sep 9, 2025

    Gemma 3n (huggingface#39059)

    ...

    d98d54b

    Gemma 3n (huggingface#39059)

    ...

    35a22f1

    Gemma 3n (huggingface#39059)

    ...

    270b984

    Gemma 3n (huggingface#39059)

    ...

    beceee4

    Gemma 3n (huggingface#39059)

    ...

    5fe40b0

    Gemma 3n (huggingface#39059)

    ...

    deb6be6

    Gemma 3n (huggingface#39059)

    ...

    f39d75e