Research Engineer / Research Scientist, Tokens

When to Use

• Frame research questions on tokens, context length, or inference cost
• Design experiments with baselines, ablations, and statistical rigor
• Build benchmarks for tokens-per-successful-task, effective context, cache leverage
• Measure tokenizer and formatting effects on length and model behavior
• Evaluate compression, summarization, routing, or distillation for token savings
• Analyze long-context phenomena (needle, lost-in-middle, attention budget)
• Write research memos with reproducible methods and honest limitations
• Translate findings into actionable thresholds for engineering and product

When NOT to Use