neuralmind.uk / Code/Document Scoring Edit this page on GitHub ↗

Code/Document Scoring

NeuralMind v3.1.4+ detects query intent and can boost results of the matching type.

Changed in v4.12.0: an intent detected from the wording of a question no longer re-weights hits by default; only a type you ask for does (--type code|docs, or the MCP query_type). The detector is a keyword heuristic, and it read “how does X…” questions as documentation questions. On the 150-question retrieval eval, turning detected-intent re-weighting back on costs 3 questions overall, and the markdown-heavy repository drops from 77% to 67% hit@5. NEURALMIND_AUTO_INTENT_BOOST=1 restores it. Under a code intent a docstring now counts as the code it documents; markdown is still marked down. (release notes)

The Problem

By default, documents (READMEs, changelogs, wikis) dominate search results — even for code-framed queries like “Show me the auth.py implementation.” This happens because:

The Solution

NeuralMind detects query intent and applies type-aware boosting when you ask for a type (and, with NEURALMIND_AUTO_INTENT_BOOST=1, when it detects one):

Intent Code Nodes Doc Nodes
code × 3.0 × 0.5
docs × 0.7 × 2.0
auto (default since v4.12.0) × 1.0 × 1.0
auto + NEURALMIND_AUTO_INTENT_BOOST=1, code detected × 3.0 × 0.5
auto + NEURALMIND_AUTO_INTENT_BOOST=1, docs detected × 0.7 × 2.0

Tests and example scripts are the other kind of hit that crowds out the code on a repository indexed from its root: a test repeats the names of the code it tests, and an example uses the words of a question about what it shows. Both score half (NEURALMIND_TEST_FILE_FACTOR since v4.12.0, NEURALMIND_EXAMPLE_FILE_FACTOR since v4.12.1) unless the question asks about tests or for an example, whatever the intent.

Usage

# No type asked for (default): no re-weighting since v4.12.0
neuralmind query . "implement authentication middleware"

# Explicit code filter
neuralmind query . "Show me the auth.py implementation" --type code

# Explicit docs filter
neuralmind query . "Explain the architecture" --type docs

Configuring Boost Factors

# Increase code boost (default: 3.0)
NEURALMIND_CODE_BOOST=5.0 neuralmind query . "auth.py" --type code

# Increase doc boost (default: 2.0)
NEURALMIND_DOC_BOOST=4.0 neuralmind query . "architecture" --type docs

# Adjust intent threshold (default: 0.6)
NEURALMIND_INTENT_THRESHOLD=0.8 neuralmind query . "auth"

Lower threshold = more sensitive detection. Higher threshold = more queries classified as hybrid.

How It Works

  1. Keyword matching — queries containing file paths (.py, .ts), code keywords (def, class, implement), or function names get code intent
  2. Doc indicators — queries with explain, what is, how does, documentation get docs intent
  3. File path detection — regex matches like src/auth/handler.py strongly signal code intent
  4. Scoring — code and doc scores are computed, threshold applied for final classification

Results

The v3.1.4 targets, when L3 held four hits and detected intent re-weighted them: