install on databricks

[Jackie0601zhou]

How can I install unsloth on databricks notebook?
I tried "pip install "unsloth[cu121-ampere-torch220] @ git+https://github.com/unslothai/unsloth.git"
and I met:
Cloning https://github.com/unslothai/unsloth.git to /tmp/pip-install-rst_tpkk/unsloth_e8849fa753954ad5b20ad0a81efbd0be
Running command git clone --filter=blob:none --quiet https://github.com/unslothai/unsloth.git /tmp/pip-install-rst_tpkk/unsloth_e8849fa753954ad5b20ad0a81efbd0be
fatal: unable to access 'https://github.com/unslothai/unsloth.git/': gnutls_handshake() failed: The TLS connection was non-properly terminated.
error: subprocess-exited-with-error

[danielhanchen]

That seems like internet access does not work maybe?

[Jackie0601zhou]

I used the HTTPS url and choose github as gitprovider when I added a repo to databricks. I also installed specific version of various packages.
All the steps before trainer_stats = trainer.train() were good. But when I run trainer_stats = trainer.train(), it show:

[jvhuang1786]

Currently getting the same issue as Jackie. I'm in a more regulated environment for databricks so I have to first download the repo and install through volumes. I have a suspicion that it's a dependency conflict but not too sure where to start looking.

[KwesiD]

I'm also getting the same issue. I've tried installing different versions of the packages, but I end up with the same error.

[danielhanchen]

Hmmm wait is databricks using MLFlow?

[KwesiD]

Yes. By default Databricks logs the runs with MLFlow.

[danielhanchen]

Hmmm ok - oh also is Databricks multi GPU?

[KwesiD]

In my instance, I'm only using a single GPU. It's possible to set up a multi GPU cluster, though.

[danielhanchen]

Hmmm tbh I haven't tried Databricks so I can't exactly debug it - I'll see what I can do, but can't promise anything sorrty