Skip to content

Commit 57b46d8

Browse files
committed
Add a bunch of base2 thinking variants for testing (will remove them soon)
1 parent 1d99371 commit 57b46d8

File tree

8 files changed

+115
-3
lines changed

8 files changed

+115
-3
lines changed

.agents/base2/base2.ts

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -155,7 +155,7 @@ ${
155155
7. Inform the user that you have completed the task in one sentence without a final summary. Don't create any markdown summary files either, unless asked by the user.`
156156
: `3. IMPORTANT: You must spawn a base2-gpt-5-worker agent inline (with spawn_agent_inline tool) to do the planning and editing.
157157
4. Fix any issues left by the base2-gpt-5-worker agent.
158-
5. Inform the user that you have completed the task in one sentence without a final summary. Don't create any markdown summary files either, unless asked by the user.`
158+
5. Inform the user that you have completed the task in one sentence without a final summary. Don't create any markdown summary files either, unless asked by the user. If you already finished the user request and said you're done, then don't say anything else.`
159159
}`,
160160

161161
stepPrompt: `Don't forget to spawn agents that could help, especially: the file-picker-max and code-searcher to get codebase context,${isNormal ? ' the generate-plan agent to create a plan,' : isMax ? ' the base2-gpt-5-worker agent to do the planning and editing,' : ''}${!isFast ? ' code-reviewer to review changes, and the validator to run validation commands' : ''}.`,
Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
import { createBase2 } from '../base2'
2+
3+
const base2Fast = createBase2('fast')
4+
const definition = {
5+
...base2Fast,
6+
id: 'base2-fast-thinker-gpt-5',
7+
displayName: 'Buffy the Fast Thinking GPT-5 Orchestrator',
8+
spawnableAgents: [...(base2Fast.spawnableAgents ?? []), 'thinker-gpt-5'],
9+
10+
instructionsPrompt: `${base2Fast.instructionsPrompt}
11+
12+
## Use the thinker agent
13+
14+
Use the spawn_agents tool to spawn a thinker-gpt-5 agent at any point to help you solve a complex problem or plan your solution.`,
15+
}
16+
export default definition
Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
import { createBase2 } from '../base2'
2+
3+
const base2Fast = createBase2('fast')
4+
const definition = {
5+
...base2Fast,
6+
id: 'base2-fast-thinker',
7+
displayName: 'Buffy the Fast Thinker Orchestrator',
8+
spawnableAgents: [...(base2Fast.spawnableAgents ?? []), 'thinker'],
9+
10+
instructionsPrompt: `${base2Fast.instructionsPrompt}
11+
12+
## Use the thinker agent
13+
14+
Use the spawn_agents tool to spawn a thinker agent at any point to help you solve a complex problem or plan your solution.`,
15+
}
16+
export default definition
Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
import { createBase2 } from '../base2'
2+
3+
const base2Fast = createBase2('fast')
4+
const definition = {
5+
...base2Fast,
6+
id: 'base2-fast-thinking-tags',
7+
displayName: 'Buffy the Fast Thinking Tags Orchestrator',
8+
instructionsPrompt: `${base2Fast.instructionsPrompt}
9+
10+
## Thinking
11+
12+
Before each response, you must use the <thinking> tags to think about what you will do next to work towards completing the user's request. Be extremely concise in your thinking.`,
13+
}
14+
export default definition
Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,15 @@
1+
import { createBase2 } from '../base2'
2+
3+
const base2Fast = createBase2('fast')
4+
const definition = {
5+
...base2Fast,
6+
id: 'base2-fast-thinking-tool',
7+
displayName: 'Buffy the Fast Thinking Tool Orchestrator',
8+
toolNames: [...(base2Fast.toolNames ?? []), 'think_deeply'],
9+
instructionsPrompt: `${base2Fast.instructionsPrompt}
10+
11+
## Thinking
12+
13+
Before each response, you must use the think_deeply tool to think about what you will do next to work towards completing the user's request. Be extremely concise in your thinking. You can skip thinking if you already know what to do.`,
14+
}
15+
export default definition
Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
import { createBase2 } from '../base2'
2+
3+
const definition = {
4+
...createBase2('fast'),
5+
id: 'base2-fast-thinking',
6+
displayName: 'Buffy the Fast Thinking Orchestrator',
7+
reasoningOptions: {
8+
enabled: true,
9+
exclude: false,
10+
effort: 'low',
11+
},
12+
}
13+
export default definition

.agents/thinker/thinker-gpt-5.ts

Lines changed: 38 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,38 @@
1+
import { publisher } from '../constants'
2+
3+
import type { SecretAgentDefinition } from '../types/secret-agent-definition'
4+
5+
const definition: SecretAgentDefinition = {
6+
id: 'thinker-gpt-5',
7+
publisher,
8+
model: 'openai/gpt-5',
9+
displayName: 'Theo the Theorizer',
10+
spawnerPrompt:
11+
'Does deep thinking given the current messages and a specific prompt to focus on. Use this to help you solve a specific problem.',
12+
inputSchema: {
13+
prompt: {
14+
type: 'string',
15+
description: 'The problem you are trying to solve',
16+
},
17+
},
18+
outputMode: 'last_message',
19+
inheritParentSystemPrompt: true,
20+
includeMessageHistory: true,
21+
spawnableAgents: [],
22+
23+
instructionsPrompt: `
24+
Think deeply, step by step, about the user request and how best to approach it.
25+
26+
Consider edge cases, potential issues, and alternative approaches. Also, propose reading files or spawning agents to get more context that would be helpful for solving the problem.
27+
28+
Come up with a list of insights that would help someone arrive at the best solution.
29+
30+
Try not to be too prescriptive or confident in one solution. Instead, give clear arguments and reasoning.
31+
32+
You must be extremely concise and to the point.
33+
34+
**Important**: Do not use any tools! You are only thinking!
35+
`.trim(),
36+
}
37+
38+
export default definition

evals/buffbench/main.ts

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -5,8 +5,8 @@ import { runBuffBench } from './run-buffbench'
55
async function main() {
66
await runBuffBench({
77
evalDataPath: path.join(__dirname, 'eval-codebuff.json'),
8-
agents: ['base2-max', 'base2-max-simple'],
9-
taskConcurrency: 10,
8+
agents: ['base2-fast-thinker', 'base2-fast-thinker-gpt-5'],
9+
taskConcurrency: 2,
1010
})
1111

1212
process.exit(0)

0 commit comments

Comments
 (0)