Errors while trying to run the examples

[aneeshmb02]

I am trying to run the examples just to make sure it works. I am running into this error: ImportError: cannot import name 'layout' from 'lit_nlp.api'. Why is it happening and what can I do?

[RyanMullins]

How have you installed LIT in your environment, via the repo or the pip package?

[aneeshmb02]

Using pip. And I had to install 0.4.1 because with the newer version I was getting another error (type object not subscriptable)

[RyanMullins]

For reference v0.4.1 is 2.5 years old and definitely not recommended for use by the team, so I'm very curious what's going on here and would strongly prefer to help you get on the mainline release.

Can you say more about your Python environment and setup...

• What kind of hardware are you running on (specifically curious if this is an Apple M-series chip because that affects a lot. of deps, see Default source install instructions shows scary errors and seems to fail... #1438 and Default docker install instructions shows scary errors and seems to fail... #1437)
• Which Python version are you using (we require v3.10+ via pip or v3.9+ if installing from the dev branch via the repo)?
• Are you running in a notebook or not?

Also, any error logs you can provide would be helpful.

[aneeshmb02]

Initially I got the error TypeError: 'type' object is not subscriptable. When I looked it up in issues, I found #976 and it mentioned installing v0.4.1 so I did. It seemed to resolve that issue but cause another one. Turns out python being outdated was the issue all along.
Now I am using python3.11 (Ubuntu 20.04, Intel cpu).
I am not using a notebook. Simply trying to run the .py (Using python itself though, couldn't get blaze to work)
But now I am getting the following error : AttributeError: module 'keras' has no attribute 'config'.

[RyanMullins]

Sounds like you're trying to use our LM Salience demo?

That Keras issues means you need to force upgrade the library to v3; tensorflow v2.15 installs Keras v2 by default but v3 is required for that demo (and iirc is the only demo we have that requires v3).

pip install -U keras keras-nlp

[aneeshmb02]

I am still getting the same error. But maybe I do not need to run this demo at all.
My objective is to use LIT to analyze a couple of llms and explain their output for particular inputs. I also need to compare variously quantized versions of those models. Can you please guide me? (I am an inexperienced intern so please excuse me)

[RyanMullins]

Would it be helpful to schedule a video call to talk through the LIT setup? You should be able to see my email on my profile page. Send me an email and we can figure out a time.

[wandabwa2004]

I'm facing issues too @RyanMullins. For example from lit_nlp.examples.datasets import lm as lm_data and from lit_nlp.examples.models import instrumented_keras_lms return ModuleNotFoundError: No module named 'lit_nlp.examples.datasets' errors. The modules are missing in the examples folder in this repo. Would you please guide on this?

[bdu91]

The datasets and models are moved.

from lit_nlp.examples.datasets import lm as lm_data -> from lit_nlp.examples.prompt_debugging import datasets as lm_data.

from lit_nlp.examples.models import instrumented_keras_lms -> from lit_nlp.examples.prompt_debugging import keras_lms

Where did you find this line of code that causes the error? We should fix this if it is still there.

[RyanMullins]

@bdu91 I have the fix out for review now. Should be live on DevSite tomorrow morning.

[RyanMullins]

@wandabwa2004 the docs are now updated (with significantly fewer steps) for LIT v1.2. Let me know if you run into further issues.

[wandabwa2004]

Hello @RyanMullins . The updated one works well on Google Colab. However, I've been trying to set it up locally and I've run into issues and and specifically with building front end files. No error is shown but nothing is shown as output(just a blank page ). Do you have a sample notebook that interfaces with other LLMs that are stored locally?

[wandabwa2004]

Sorry but how do I run a local example with this syntax:
python3 -m lit_nlp.examples.prompt_debugging.server -- \ --models=gemma:gemma_1.1_instruct_2b_en \ --alsologtostderr

I used something like this for Mistral model. I'm not able to use HF link so have the model in a location:
python3 -m lit_nlp.examples.prompt_debugging.server -- \ --models=mistral:/home/xxx/mistral \ --alsologtostderr

Throws the error "ValueError: Unknown preset identifier. A preset must be ......

How do I set the preset for the path to a local file?