Remove linkbert
article thumbnail

Stanford AI Lab Papers and Talks at ACL 2022

The Stanford AI Lab Blog

We’re excited to share all the work from SAIL that’s being presented, and you’ll find links to papers, videos and blogs below. Feel free to reach out to the contact authors directly to learn more about the work that’s happening at Stanford! Fu, Mayee F.

article thumbnail

LinkBERT: Improving Language Model Training with Document Link

The Stanford AI Lab Blog

In our recent work 9 published at ACL 2022, we develop a new pretraining method, LinkBERT , that incorporates such document link information to train language models with more world knowledge. Let’s use LinkBERT! We will now see how LinkBERT performs on several downstream natural language processing tasks.

BERT 40