Newbie problems? Cannot "run configure.py" on Apple Silicon Mac M1

[borderlineinteractive]

I am not familiar with the Poetry system and a bit confused about the installation procedure. I followed all the steps, and I can see that several dependencies including torch are installed after I enter

poetry install -C install/apple

The instructions then tell me to "run configure.py", which I assume is done by entering

python configure.py

However, I first get the error

ModuleNotFoundError: No module named 'huggingface_hub'

and after pip install huggingface-hub, entering python configure.py again gives this error:

ModuleNotFoundError: No module named 'torch'

although torch was obviously installed with the poetry install command above. This goes on, until I try to install optimi via pip, which gives me an error that no matching distribution was found.

What am I missing here? I also tried to "run configure.py" with the command

poetry run python configure.py

but this gives me the same errors. Any help would be greatly appreciated.

[bghira]

it sounds like you didn't activate the venv or some other python framework management thing is getting in the way.

[borderlineinteractive]

This indeed might be related to different dependency management tools:

I searched for the newly installed packages and found them in my miniconda3 python3.11 folder:

/Users/username/miniconda3/lib/python3.11/site-packages

I did not activate anything related to miniconda, and do not really understand what is going on with these different dependency management tools. The installation of miniconda and of Simpletuner are on different hard drives. Any help would be greatly appreciated.

I started by restarting the terminal and without and venv activated:

(base) username@usermac ~ %

and then closely followed the instructions. By the way, the dependency for the not existing https://github.com/bghira/optimum-quanto-simpletuner ist still active in the release branch for the apple installation, and I therefore used the main branch:

git clone --branch=main https://github.com/bghira/SimpleTuner.git

cd SimpleTuner

python -m venv .venv (I have Python 3.11.10)

source .venv/bin/activate

now the prompt shows that the venv is activated as expected:

(.venv) (base) username@usermac SimpleTuner %

pip install -U poetry pip

Now several dependencies are being installed together with Poetry - I am getting a bunch of Warnings:

Collecting poetry
  Using cached poetry-1.8.5-py3-none-any.whl.metadata (6.9 kB)
Requirement already satisfied: pip in ./.venv/lib/python3.11/site-packages (24.0)
Collecting pip
  Using cached pip-24.3.1-py3-none-any.whl.metadata (3.7 kB)
Collecting build<2.0.0,>=1.0.3 (from poetry)
  Using cached build-1.2.2.post1-py3-none-any.whl.metadata (6.5 kB)
Collecting cachecontrol<0.15.0,>=0.14.0 (from cachecontrol[filecache]<0.15.0,>=0.14.0->poetry)
  Using cached cachecontrol-0.14.1-py3-none-any.whl.metadata (3.1 kB)
Collecting cleo<3.0.0,>=2.1.0 (from poetry)
  Using cached cleo-2.1.0-py3-none-any.whl.metadata (12 kB)
Collecting crashtest<0.5.0,>=0.4.1 (from poetry)
  Using cached crashtest-0.4.1-py3-none-any.whl.metadata (1.1 kB)
Collecting dulwich<0.22.0,>=0.21.2 (from poetry)
  Using cached dulwich-0.21.7-cp311-cp311-macosx_11_0_arm64.whl.metadata (4.3 kB)
Collecting fastjsonschema<3.0.0,>=2.18.0 (from poetry)
  Using cached fastjsonschema-2.21.1-py3-none-any.whl.metadata (2.2 kB)
Collecting installer<0.8.0,>=0.7.0 (from poetry)
  Using cached installer-0.7.0-py3-none-any.whl.metadata (936 bytes)
Collecting keyring<25.0.0,>=24.0.0 (from poetry)
  Using cached keyring-24.3.1-py3-none-any.whl.metadata (20 kB)
Collecting packaging>=23.1 (from poetry)
  Using cached packaging-24.2-py3-none-any.whl.metadata (3.2 kB)
Collecting pexpect<5.0.0,>=4.7.0 (from poetry)
  Using cached pexpect-4.9.0-py2.py3-none-any.whl.metadata (2.5 kB)
Collecting pkginfo<2.0,>=1.12 (from poetry)
  Using cached pkginfo-1.12.0-py3-none-any.whl.metadata (12 kB)
Collecting platformdirs<5,>=3.0.0 (from poetry)
  Using cached platformdirs-4.3.6-py3-none-any.whl.metadata (11 kB)
Collecting poetry-core==1.9.1 (from poetry)
  Using cached poetry_core-1.9.1-py3-none-any.whl.metadata (3.5 kB)
Collecting poetry-plugin-export<2.0.0,>=1.6.0 (from poetry)
  Using cached poetry_plugin_export-1.8.0-py3-none-any.whl.metadata (2.8 kB)
Collecting pyproject-hooks<2.0.0,>=1.0.0 (from poetry)
  Using cached pyproject_hooks-1.2.0-py3-none-any.whl.metadata (1.3 kB)
Collecting requests<3.0,>=2.26 (from poetry)
  Using cached requests-2.32.3-py3-none-any.whl.metadata (4.6 kB)
Collecting requests-toolbelt<2.0.0,>=1.0.0 (from poetry)
  Using cached requests_toolbelt-1.0.0-py2.py3-none-any.whl.metadata (14 kB)
Collecting shellingham<2.0,>=1.5 (from poetry)
  Using cached shellingham-1.5.4-py2.py3-none-any.whl.metadata (3.5 kB)
Collecting tomlkit<1.0.0,>=0.11.4 (from poetry)
  Using cached tomlkit-0.13.2-py3-none-any.whl.metadata (2.7 kB)
Collecting trove-classifiers>=2022.5.19 (from poetry)
  Using cached trove_classifiers-2024.10.21.16-py3-none-any.whl.metadata (2.2 kB)
Collecting virtualenv<21.0.0,>=20.26.6 (from poetry)
  Using cached virtualenv-20.28.0-py3-none-any.whl.metadata (4.4 kB)
Collecting xattr<2.0.0,>=1.0.0 (from poetry)
  Using cached xattr-1.1.0-cp311-cp311-macosx_11_0_arm64.whl.metadata (3.8 kB)
Collecting msgpack<2.0.0,>=0.5.2 (from cachecontrol<0.15.0,>=0.14.0->cachecontrol[filecache]<0.15.0,>=0.14.0->poetry)
  Using cached msgpack-1.1.0-cp311-cp311-macosx_11_0_arm64.whl.metadata (8.4 kB)
Collecting filelock>=3.8.0 (from cachecontrol[filecache]<0.15.0,>=0.14.0->poetry)
  Using cached filelock-3.16.1-py3-none-any.whl.metadata (2.9 kB)
Collecting rapidfuzz<4.0.0,>=3.0.0 (from cleo<3.0.0,>=2.1.0->poetry)
  Using cached rapidfuzz-3.10.1-cp311-cp311-macosx_11_0_arm64.whl.metadata (11 kB)
Collecting urllib3>=1.25 (from dulwich<0.22.0,>=0.21.2->poetry)
  Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB)
Collecting jaraco.classes (from keyring<25.0.0,>=24.0.0->poetry)
  Using cached jaraco.classes-3.4.0-py3-none-any.whl.metadata (2.6 kB)
Collecting importlib-metadata>=4.11.4 (from keyring<25.0.0,>=24.0.0->poetry)
  Using cached importlib_metadata-8.5.0-py3-none-any.whl.metadata (4.8 kB)
Collecting ptyprocess>=0.5 (from pexpect<5.0.0,>=4.7.0->poetry)
  Using cached ptyprocess-0.7.0-py2.py3-none-any.whl.metadata (1.3 kB)
Collecting charset-normalizer<4,>=2 (from requests<3.0,>=2.26->poetry)
  Using cached charset_normalizer-3.4.0-cp311-cp311-macosx_11_0_arm64.whl.metadata (34 kB)
Collecting idna<4,>=2.5 (from requests<3.0,>=2.26->poetry)
  Using cached idna-3.10-py3-none-any.whl.metadata (10 kB)
Collecting certifi>=2017.4.17 (from requests<3.0,>=2.26->poetry)
  Using cached certifi-2024.8.30-py3-none-any.whl.metadata (2.2 kB)
Collecting distlib<1,>=0.3.7 (from virtualenv<21.0.0,>=20.26.6->poetry)
  Using cached distlib-0.3.9-py2.py3-none-any.whl.metadata (5.2 kB)
Collecting cffi>=1.16.0 (from xattr<2.0.0,>=1.0.0->poetry)
  Using cached cffi-1.17.1-cp311-cp311-macosx_11_0_arm64.whl.metadata (1.5 kB)
Collecting pycparser (from cffi>=1.16.0->xattr<2.0.0,>=1.0.0->poetry)
  Using cached pycparser-2.22-py3-none-any.whl.metadata (943 bytes)
Collecting zipp>=3.20 (from importlib-metadata>=4.11.4->keyring<25.0.0,>=24.0.0->poetry)
  Using cached zipp-3.21.0-py3-none-any.whl.metadata (3.7 kB)
Collecting more-itertools (from jaraco.classes->keyring<25.0.0,>=24.0.0->poetry)
  Using cached more_itertools-10.5.0-py3-none-any.whl.metadata (36 kB)
Using cached poetry-1.8.5-py3-none-any.whl (249 kB)
Using cached poetry_core-1.9.1-py3-none-any.whl (309 kB)
Using cached pip-24.3.1-py3-none-any.whl (1.8 MB)
Using cached build-1.2.2.post1-py3-none-any.whl (22 kB)
Using cached cachecontrol-0.14.1-py3-none-any.whl (22 kB)
Using cached cleo-2.1.0-py3-none-any.whl (78 kB)
Using cached crashtest-0.4.1-py3-none-any.whl (7.6 kB)
Using cached dulwich-0.21.7-cp311-cp311-macosx_11_0_arm64.whl (475 kB)
Using cached fastjsonschema-2.21.1-py3-none-any.whl (23 kB)
Using cached installer-0.7.0-py3-none-any.whl (453 kB)
Using cached keyring-24.3.1-py3-none-any.whl (38 kB)
Using cached packaging-24.2-py3-none-any.whl (65 kB)
Using cached pexpect-4.9.0-py2.py3-none-any.whl (63 kB)
Using cached pkginfo-1.12.0-py3-none-any.whl (32 kB)
Using cached platformdirs-4.3.6-py3-none-any.whl (18 kB)
Using cached poetry_plugin_export-1.8.0-py3-none-any.whl (10 kB)
Using cached pyproject_hooks-1.2.0-py3-none-any.whl (10 kB)
Using cached requests-2.32.3-py3-none-any.whl (64 kB)
Using cached requests_toolbelt-1.0.0-py2.py3-none-any.whl (54 kB)
Using cached shellingham-1.5.4-py2.py3-none-any.whl (9.8 kB)
Using cached tomlkit-0.13.2-py3-none-any.whl (37 kB)
Using cached trove_classifiers-2024.10.21.16-py3-none-any.whl (13 kB)
Using cached virtualenv-20.28.0-py3-none-any.whl (4.3 MB)
Using cached xattr-1.1.0-cp311-cp311-macosx_11_0_arm64.whl (19 kB)
Using cached certifi-2024.8.30-py3-none-any.whl (167 kB)
Using cached cffi-1.17.1-cp311-cp311-macosx_11_0_arm64.whl (178 kB)
Using cached charset_normalizer-3.4.0-cp311-cp311-macosx_11_0_arm64.whl (118 kB)
Using cached distlib-0.3.9-py2.py3-none-any.whl (468 kB)
Using cached filelock-3.16.1-py3-none-any.whl (16 kB)
Using cached idna-3.10-py3-none-any.whl (70 kB)
Using cached importlib_metadata-8.5.0-py3-none-any.whl (26 kB)
Using cached msgpack-1.1.0-cp311-cp311-macosx_11_0_arm64.whl (81 kB)
Using cached ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB)
Using cached rapidfuzz-3.10.1-cp311-cp311-macosx_11_0_arm64.whl (1.4 MB)
Using cached urllib3-2.2.3-py3-none-any.whl (126 kB)
Using cached jaraco.classes-3.4.0-py3-none-any.whl (6.8 kB)
Using cached zipp-3.21.0-py3-none-any.whl (9.6 kB)
Using cached more_itertools-10.5.0-py3-none-any.whl (60 kB)
Using cached pycparser-2.22-py3-none-any.whl (117 kB)
Installing collected packages: trove-classifiers, ptyprocess, fastjsonschema, distlib, zipp, urllib3, tomlkit, shellingham, rapidfuzz, pyproject-hooks, pycparser, poetry-core, platformdirs, pkginfo, pip, pexpect, packaging, msgpack, more-itertools, installer, idna, filelock, crashtest, charset-normalizer, certifi, virtualenv, requests, jaraco.classes, importlib-metadata, dulwich, cleo, cffi, build, xattr, requests-toolbelt, keyring, cachecontrol, poetry-plugin-export, poetry
  Attempting uninstall: pip
    Found existing installation: pip 24.0
    Uninstalling pip-24.0:
      Successfully uninstalled pip-24.0
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'
Successfully installed build cachecontrol certifi cffi charset-normalizer cleo crashtest distlib dulwich fastjsonschema filelock idna importlib-metadata installer jaraco.classes keyring more-itertools msgpack packaging pexpect pip pkginfo platformdirs poetry poetry-core poetry-plugin-export ptyprocess pycparser pyproject-hooks rapidfuzz requests requests-toolbelt shellingham tomlkit trove-classifiers urllib3 virtualenv xattr zipp
WARNING: Skipping /Volumes/DATA/temp/SimpleTuner/.venv/lib/python3.11/site-packages/pip-24.0.dist-info due to invalid metadata entry 'name'

poetry config virtualenvs.create false

poetry install -C install/apple

Skipping virtualenv creation, as specified in config file.
Installing dependencies from lock file

Package operations: 0 installs, 38 updates, 0 removals

  - Updating certifi (2024.7.4 -> 2024.8.30)
  - Updating filelock (3.15.4 -> 3.16.0)
  - Updating idna (3.7 -> 3.8)
  - Downgrading sympy (1.13.2 -> 1.13.1)
  - Updating urllib3 (1.26.19 -> 1.26.20)
  - Updating multidict (6.0.5 -> 6.1.0)
  - Updating torch (2.4.1 -> 2.5.0)
  - Updating aiohappyeyeballs (2.3.6 -> 2.4.0)
  - Updating safetensors (0.4.4 -> 0.4.5)
  - Updating torchvision (0.19.1 -> 0.20.0)
  - Updating yarl (1.9.4 -> 1.11.1)
  - Updating zipp (3.20.0 -> 3.20.1)
  - Updating aiohttp (3.10.3 -> 3.10.5)
  - Updating botocore (1.34.162 -> 1.35.24)
  - Downgrading dill (0.3.8 -> 0.3.7)
  - Updating importlib-metadata (8.2.0 -> 8.4.0)
  - Updating setuptools (72.2.0 -> 74.1.2)
  - Updating timm (1.0.8 -> 1.0.9)
  - Updating tokenizers (0.19.1 -> 0.20.3)
  - Updating accelerate (0.34.0 -> 0.34.2)
  - Updating diffusers (0.30.0 -> 0.32.0.dev0 bd13e36)
  - Updating grpcio (1.65.4 -> 1.66.1)
  - Updating lightning-utilities (0.11.6 -> 0.11.7)
  - Downgrading multiprocess (0.70.16 -> 0.70.15)
  - Updating pandas (2.2.2 -> 2.2.3)
  - Updating platformdirs (4.2.2 -> 4.3.2)
  - Updating protobuf (4.25.4 -> 5.28.1)
  - Updating pyparsing (3.1.2 -> 3.1.4)
  - Updating scipy (1.14.0 -> 1.14.1)
  - Updating sentry-sdk (2.13.0 -> 2.14.0)
  - Updating transformers (4.43.4 -> 4.46.3)
  - Updating werkzeug (3.0.3 -> 3.0.4)
  - Updating xxhash (3.4.1 -> 3.5.0)
  - Updating boto3 (1.34.162 -> 1.35.24)
  - Updating datasets (2.21.0 -> 3.0.0)
  - Updating lycoris-lora (3.0.1.dev8 e2acc05 -> 3.0.1.dev14 8978355)
  - Updating peft (0.11.1 -> 0.12.0)
  - Updating wandb (0.17.8 -> 0.18.1)

Everything looks ok here, but if I use pip list, I get the following output, which does not include the torch:

Package              Version
-------------------- -------------
build                1.2.2.post1
CacheControl         0.14.1
certifi              2024.8.30
cffi                 1.17.1
charset-normalizer   3.4.0
cleo                 2.1.0
crashtest            0.4.1
distlib              0.3.9
dulwich              0.21.7
fastjsonschema       2.21.1
filelock             3.16.1
idna                 3.10
importlib_metadata   8.5.0
installer            0.7.0
jaraco.classes       3.4.0
keyring              24.3.1
more-itertools       10.5.0
msgpack              1.1.0
packaging            24.2
pexpect              4.9.0
pip                  24.3.1
pkginfo              1.12.0
platformdirs         4.3.6
poetry               1.8.5
poetry-core          1.9.1
poetry-plugin-export 1.8.0
ptyprocess           0.7.0
pycparser            2.22
pyproject_hooks      1.2.0
RapidFuzz            3.10.1
requests             2.32.3
requests-toolbelt    1.0.0
setuptools           65.5.0
shellingham          1.5.4
tomlkit              0.13.2
trove-classifiers    2024.10.21.16
urllib3              2.2.3
virtualenv           20.28.0
xattr                1.1.0
zipp                 3.21.0

[bghira]

thanks for the additional feedback. try not to use pip to install packages, instead, just leave the venv to Poetry.

i've updated the apple torch and quanto dependencies and verified it on an M3 Max. that's now on the main branch.