Skip to content

RPS2: Use a more capable LLM and modify prompts a bit. #4

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
JamesVorder merged 1 commit into from
Aug 1, 2024
Merged

RPS2: Use a more capable LLM and modify prompts a bit. #4

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 0 additions & 13 deletions assets/test_class.py
View file
Open in desktop

This file was deleted.

18 changes: 14 additions & 4 deletions main.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,10 @@ def chat(
Do not say 'here is the python code'
Do not surround your response with quotes or backticks.
DO NOT EVER USE ``` in your output.
You should maintain any comments that were provided in the class skeleton.
You should maintain the exact method signatures provided in the class skeleton.
Your output MUST be valid, runnable python code and NOTHING else.
Your output MUST NOT include any usage of testing tools like unittest, pytest, mock, etc.
{code_gen_agent.class_skeleton}
"""
)
Expand All @@ -51,8 +54,11 @@ def chat(
prompt=f"""
You are an expert at interpreting the results of unit tests, and providing insight into what they mean.
You should be descriptive about what variables are incorrect, and in what way.
You should include information about which methods should be modified, and in what way.
You should generally not provide code.
You should include information about which methods should be modified, and in what way (without providing code.)
You should not provide code.
You should NEVER attempt to modify the tests, or give advice to modify the tests.
Give results in a bulleted list, with one bullet for each method that fails tests.
Keep insights very brief, providing a maximum of 3 sentences about each method that failed a test.
Please provide insights about the following test results:
{test_interpreter.latest_test_results}
Those results were produced by the following code:
Expand All @@ -65,7 +71,7 @@ def chat(
code_attempt = code_gen_agent.respond(
prompt=f"""
You are an expert at writing Python code.
Consider the following code, and test results.
Consider the following code, and the following test results.
Here is the code:
{code_gen_agent.previous_code_attempt}
Here are the test results:
Expand All @@ -80,7 +86,10 @@ def chat(
Do not surround your response with quotes or backticks.
DO NOT EVER USE ``` in your output.
Your response should NEVER start or end with ```
You should maintain any comments that were provided in the code.
You should maintain the exact method signatures provided in the code.
Your output MUST be valid, runnable python code and NOTHING else.
Your output MUST NOT include any usage of testing tools like unittest, pytest, mock, etc.
"""
)
if not solved:
Expand Down Expand Up @@ -126,7 +135,8 @@ def main(

llama3 = ChatAgentConfig(
llm=lr.language_models.OpenAIGPTConfig(
chat_model="ollama/llama3:latest",
chat_model="ollama/llama3.1:latest",
chat_context_length=128000
),
vecdb=None
)
Expand Down