Thanks for the PR 🚀

But there is one nuance 😊
We need to check for free disk space that is at least 2x of the model weight's size.
The code first downloads weights from HF and then converts to lit format -lit_model.pth.
Even if we change the code to delete HF weights right after the conversion, then still at the same time two sets of weights will exist (during conversion, before the deletion).

But there is one nuance 😊
We need to check for free disk space that is at least 2x of the model weight's size.
The code first downloads weights from HF and then converts to lit format - lit_model.pth.
Even if we change the code to delete HF weights right after the conversion, then still at the same time two sets of weights will exist (during conversion, before the deletion).

Thanks, that's great and important point!

RE CI failures: I actually now what happened here: thetransformer package had a new release a few days back and this caused some issues with the rope unit tests (unrelated to this PR). I know how to fix and can take a look the next couple of days.

@Andrei-Aksionov RoPE tests should be fixed now for the latest transformer release and if tests pass on CI, this should be ready to merge.

Ok there seem to be other issues now with the Phi model. Also unrelated to this PR. Maybe microsoft changed something. Or the transformers library changed something.

Probably.
I think these issues need to be resolved in separate PRs.
Then merged to this one.