Hacker Newsnew | past | comments | ask | show | jobs | submit | biobootloader's commentslogin

a new social experience...


Hey Paul, I'm a Mentat author.

> I also notice that the instructions prompt that mentat uses seems to be inspired by the aider benchmark? Glad to see others adopting similar benchmarking approaches.

We were inspired by you to use Exercism as a benchmark, thank you! We will add attribution for that. We switched our original instruction prompts for that benchmark to be similar to Aiders to allow for fair comparison.

> After looking around a bit, there seems to be a bunch of aider code in your repo. Some attribution would be appreciated.

We have an unused implementation of your output response format (https://github.com/AbanteAI/mentat/blob/main/mentat/parsers/...), but I don't know what else you are seeing? We implemented that to compare with our response formats and didn't find much difference in performance.


I didn't spend much time looking, but your benchmark prompting inspired me to search your repo for "aider". The results were 3 PRs where aider was mentioned in the conversations [0].

The "code map" PR in particular mentions being "inspired by aider", links to aider and seems to include a bunch of code from aider's old ctags based "repo map" implementation. This isn't an insignificant component of an AI coding tool.

Aider is open source and I try and share my learnings as I'm building it. So it's great when other projects get inspiration from aider! But it is polite to provide attribution for such inspiration, especially if you crib from code with an attribution license.

[0] https://github.com/search?q=repo%3AAbanteAI%2Fmentat+aider&t...


we are working on creating "real world" benchmarks that require a lot of context, and will report when we have results!


Yes, it uses your local files and edits for you. Let us know what you think!

https://github.com/AbanteAI/mentat


the idea is that mentats in dune combine human and computer skills to assist others

but yeah it is funny


Just remember, mentats exist bc the dune universe found the dangers of AI so universal and obvious they never made anything more complicated than a single-write microcontroller and used analog circuits for basically everything.


agreed! but it'd be nice to not have to jump back to the editor to fix a minor crash and then go rerun


it will sometimes fix other bugs, but yeah the focus is on ones that caused the crash or are obvious


If they are so obvious, why didn't you just do it yourself the first time? Instead of yeeting large portions of your codebase at a 3rd-party web service?


haha yes it did feel a bit wild just letting this run on my machine!

I wouldn't recommend running it on a script that's supposed to delete files


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: