microsoft

/

wavlm-large

like 106

Follow

Microsoft 20k

I got the following warning:
Some weights of the model checkpoint at microsoft/wavlm-large were not used when initializing WavLMModel: ['encoder.pos_conv_embed.conv.weight_g', 'encoder.pos_conv_embed.conv.weight_v']

• This IS expected if you are initializing WavLMModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
• This IS NOT expected if you are initializing WavLMModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).

when I tried to run this code:

from transformers import pipeline

pipe = pipeline("feature-extraction", model="microsoft/wavlm-large") Copy # Load model directly
from transformers import AutoProcessor, AutoModel

processor = AutoProcessor.from_pretrained("microsoft/wavlm-large")
model = AutoModel.from_pretrained("microsoft/wavlm-large")