trainning for word task on a custom datatset for ner

[SGidentification]

Hi, I was running the following command and I face the error bellow, do you have any idea about it?

python experiments/run_word_task.py train_configs/word-task/Llama2-bi-mntp.json

File "/workspace/llm2vec/experiments/run_word_task.py", line 740, in <module> main() File "/workspace/llm2vec/experiments/run_word_task.py", line 736, in main trainer.train() File "/usr/local/lib/python3.10/dist-packages/transformers/trainer.py", line 1885, in train return inner_training_loop( File "/usr/local/lib/python3.10/dist-packages/transformers/trainer.py", line 2216, in _inner_training_loop tr_loss_step = self.training_step(model, inputs) File "/usr/local/lib/python3.10/dist-packages/transformers/trainer.py", line 3238, in training_step loss = self.compute_loss(model, inputs) File "/usr/local/lib/python3.10/dist-packages/transformers/trainer.py", line 3264, in compute_loss outputs = model(**inputs) File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1501, in _call_impl return forward_call(*args, **kwargs) File "/workspace/llm2vec/experiments/run_word_task.py", line 93, in forward outputs = self.model( File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1501, in _call_impl return forward_call(*args, **kwargs) File "/usr/local/lib/python3.10/dist-packages/peft/peft_model.py", line 642, in forward return self.get_base_model()(*args, **kwargs) File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1501, in _call_impl return forward_call(*args, **kwargs) File "/usr/local/lib/python3.10/dist-packages/transformers/models/llama/modeling_llama.py", line 940, in forward causal_mask = self._update_causal_mask( TypeError: LlamaBiModel._update_causal_mask() takes from 4 to 5 positional arguments but 6 were give

[vaibhavad]

Hi @SGidentification,

Are you using the latest version of llm2vec? We had pushed a fix for this issue (5492ca5) when it was raised in #33.

[SGidentification]

thanks I changed the version of transformers to "transformers_version": "4.40.0" and llm2vec to 0.1.5 and now it is working