feat: add cloud storage support for session start

[Panaetius]

Also adds renku storage ls

adapted for SwissDataScienceCenter/renku-notebooks#1707 and related features

[coveralls]

Pull Request Test Coverage Report for Build 7553200191

• 0 of 0 changed or added relevant lines in 0 files are covered.
• No unchanged relevant lines lost coverage.
• Overall coverage decreased (-0.3%) to 85.167%

---

Totals
Change from base Build 7553017368:	-0.3%
Covered Lines:	26636
Relevant Lines:	31275

---

💛 - Coveralls

[olevski]

@Panaetius I started reviewing this.

But I also wanted to try it out. So I made a project, added cloud storage and then cloned it locally. Then I ran renku storage ls and I got this error:

Please select an action by typing its name (open, print, ignore) [ignore]: 
Traceback (most recent call last):
  File "/Users/tolevski/Library/Caches/pypoetry/virtualenvs/renku-LaTIHLQX-py3.10/bin/renku", line 6, in <module>
    sys.exit(cli())
  File "/Users/tolevski/Library/Caches/pypoetry/virtualenvs/renku-LaTIHLQX-py3.10/lib/python3.10/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/Users/tolevski/Documents/renku/renku-python/renku/ui/cli/exception_handler.py", line 139, in main
    self._handle_github()
  File "/Users/tolevski/Documents/renku/renku-python/renku/ui/cli/exception_handler.py", line 171, in _handle_github
    getattr(self, "_process_" + value)()
  File "/Users/tolevski/Documents/renku/renku-python/renku/ui/cli/exception_handler.py", line 131, in main
    return super().main(*args, **kwargs)
  File "/Users/tolevski/Documents/renku/renku-python/renku/ui/cli/exception_handler.py", line 90, in main
    return super().main(*args, **kwargs)
  File "/Users/tolevski/Library/Caches/pypoetry/virtualenvs/renku-LaTIHLQX-py3.10/lib/python3.10/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/Users/tolevski/Library/Caches/pypoetry/virtualenvs/renku-LaTIHLQX-py3.10/lib/python3.10/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/Users/tolevski/Library/Caches/pypoetry/virtualenvs/renku-LaTIHLQX-py3.10/lib/python3.10/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/Users/tolevski/Library/Caches/pypoetry/virtualenvs/renku-LaTIHLQX-py3.10/lib/python3.10/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/Users/tolevski/Library/Caches/pypoetry/virtualenvs/renku-LaTIHLQX-py3.10/lib/python3.10/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/Users/tolevski/Documents/renku/renku-python/renku/ui/cli/storage.py", line 59, in ls
    result = list_storage_command().build().execute()
  File "/Users/tolevski/Documents/renku/renku-python/renku/command/storage.py", line 22, in list_storage_command
    from renku.core.storage import list_storage
  File "/Users/tolevski/Documents/renku/renku-python/renku/core/storage.py", line 26, in <module>
    def list_storage(storage_service: IStorageService):
  File "pydantic/decorator.py", line 36, in pydantic.decorator.validate_arguments.validate
  File "pydantic/decorator.py", line 126, in pydantic.decorator.ValidatedFunction.__init__
  File "pydantic/decorator.py", line 264, in pydantic.decorator.ValidatedFunction.create_model
  File "pydantic/main.py", line 1026, in pydantic.main.create_model
  File "pydantic/main.py", line 197, in pydantic.main.ModelMetaclass.__new__
  File "pydantic/fields.py", line 506, in pydantic.fields.ModelField.infer
  File "pydantic/fields.py", line 436, in pydantic.fields.ModelField.__init__
  File "pydantic/fields.py", line 552, in pydantic.fields.ModelField.prepare
  File "pydantic/fields.py", line 639, in pydantic.fields.ModelField._type_analysis
  File "/Users/tolevski/.pyenv/versions/3.10.8/lib/python3.10/typing.py", line 1498, in __instancecheck__
    raise TypeError("Instance and class checks can only be used with"
TypeError: Instance and class checks can only be used with @runtime_checkable protocols

[olevski]

I did not know where to put this but I think we need a warning in the docker provider that if there is any cloud storage in the project it will not be mounted. We dont have to implement this but we should let people now what the limitations are.

[olevski]

Is the expected reponse for validate supposed to be really 204?

[Panaetius]

yes when given a valid config it just returns an empty 204 and if invalid an appropriate 4xx code