Skip to content

chore(council): remove Gemini from the council - #1

Open
VencentSoliman wants to merge 1 commit into
t3dotgg:mainfrom
VencentSoliman:chore/remove-gemini-from-council
Open

VencentSoliman wants to merge 1 commit into
t3dotgg:mainfrom
VencentSoliman:chore/remove-gemini-from-council

Conversation

@VencentSoliman

Copy link
Copy Markdown

Gemini kept hallucinating in council reviews, so the council was handing out scores based on files and flags that don't exist. I removed it. The council is now two delegates (Claude Opus + GPT Sol), and the example score table loses its Gemini row.

Theo has done the research:

🃏 He gave Gemini its own "gemini the jester" section in the council skill, noting it "hallucinates in over 80% of the runs": https://x.com/i/status/2114229780065464669
🫠 "hallucination rates are truly surreal" (it quoted line 173 of a 72-line file, invented script flags and a Tailscale IP, and still gave 10/10): https://x.com/i/status/2114483219538296946
🚨 "Gemini is a straight up liability in your stack": https://x.com/i/status/2114483456646463919
🥉 "Gemini is last place 100% of the time": https://x.com/i/status/2110624496160051495

image

you forgot to remove the jester!

image

@Project516 Project516 left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe replace gemini with muse wonder full?

@Ember2819

Copy link
Copy Markdown

Yesss merge ts

@go-bayes

Copy link
Copy Markdown

This gave me a good laugh, thanks :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants