DocsCore ConceptsToken Management

Token Management

Understand and optimize token usage across your agents.

Tokens are the fundamental unit of LLM processing. Understanding token management is crucial for cost optimization and performance.

What are Tokens?

Tokens are pieces of words. On average, 1 token is about 4 characters or 0.75 words. Both input and output tokens count toward your usage.

Monitoring Usage

javascript
const usage = await client.getUsage({
  startDate: '2024-01-01',
  endDate: '2024-01-31',
  groupBy: 'agent'
});

console.log(usage);
// {
//   totalTokens: 2500000,
//   byAgent: {
//     'CustomerSupport': 1200000,
//     'DataAnalyzer': 800000,
//     'ContentWriter': 500000
//   }
// }

Optimization Tips

  • Use shorter, clearer prompts
  • Implement caching for repeated queries
  • Use appropriate models for each task
  • Set token limits per agent
Previous
Workflows