obliteratus – skill Dữ liệu & Khoa học cho agent AI

OBLITERATUS Skill

What's inside

9 CLI methods, 28 analysis modules, 116 model presets across 5 compute tiers, tournament evaluation, and telemetry-driven recommendations.

Remove refusal behaviors (guardrails) from open-weight LLMs without retraining or fine-tuning. Uses mechanistic interpretability techniques — including diff-in-means, SVD, whitened SVD, LEACE concept erasure, SAE decomposition, Bayesian kernel projection, and more — to identify and surgically excise refusal directions from model weights while preserving reasoning capabilities.

License warning: OBLITERATUS is AGPL-3.0. NEVER import it as a Python library. Always invoke via CLI (obliteratus command) or subprocess. This keeps Hermes Agent's MIT license clean.

Video Guide

Walkthrough of OBLITERATUS used by a Hermes agent to abliterate Gemma:

https://www.youtube.com/watch?v=8fG9BrNTeHs ("OBLITERATUS: An AI Agent Removed Gemma 4's Safety Guardrails")

Useful when the user wants a visual overview of the end-to-end workflow before running it themselves.

When to Use This Skill

Trigger when the user:

• Wants to "uncensor" or "abliterate" an LLM
• Asks about removing refusal/guardrails from a model
• Wants to create an uncensored version of Llama, Qwen, Mistral, etc.
• Mentions "refusal removal", "abliteration", "weight projection"
• Wants to analyze how a model's refusal mechanism works
• References OBLITERATUS, abliterator, or refusal directions

Step 1: Installation

Check if already installed:

obliteratus --version 2>/dev/null && echo "INSTALLED" || echo "NOT INSTALLED"

If not installed, clone and install from GitHub:

git clone https://github.com/elder-plinius/OBLITERATUS.git
cd OBLITERATUS
pip install -e .
# For Gradio web UI support:
# pip install -e ".[spaces]"

IMPORTANT: Confirm with user before installing. This pulls in ~5-10GB of dependencies (PyTorch, Transformers, bitsandbytes, etc.).

Step 2: Check Hardware

Before anything, check what GPU is available:

python3 -c "
import torch
if torch.cuda.is_available():
    gpu = torch.cuda.get_device_name(0)
    vram = torch.cuda.get_device_properties(0).total_memory / 1024**3
    print(f'GPU: {gpu}')
    print(f'VRAM: {vram:.1f} GB')
    if vram < 4: print('TIER: tiny (models under 1B)')
    elif vram < 8: print('TIER: small (models 1-4B)')
    elif vram < 16: print('TIER: medium (models 4-9B with 4bit quant)')
    elif vram < 32: print('TIER: large (models 8-32B with 4bit quant)')
    else: print('TIER: frontier (models 32B+)')
else:
    print('NO GPU - only tiny models (under 1B) on CPU')
"

VRAM Requirements (with 4-bit quantization)

| VRAM | Max Model Size | Example Models |

|:---------|:----------------|:--------------------------------------------|

| CPU only | ~1B params | GPT-2, TinyLlama, SmolLM |

| 4-8 GB | ~4B params | Qwen2.5-1.5B, Phi-3.5 mini, Llama 3.2 3B |

| 8-16 GB | ~9B params | Llama 3.1 8B, Mistral 7B, Gemma 2 9B |

| 24 GB | ~32B params | Qwen3-32B, Llama 3.1 70B (tight), Command-R |

| 48 GB+ | ~72B+ params | Qwen2.5-72B, DeepSeek-R1 |

| Multi-GPU| 200B+ params | Llama 3.1 405B, DeepSeek-V3 (685B MoE) |

Step 3: Browse Available Models & Get Recommendations

# Browse models by compute tier
obliteratus models --tier medium

# Get architecture info for a specific model
obliteratus info <model_name>

# Get telemetry-driven recommendation for best method & params
obliteratus recommend <model_name>
obliteratus recommend <model_name> --insights  # global cross-architecture rankings

Step 4: Choose a Method

Method Selection Guide

Default / recommended for most cases: advanced. It uses multi-direction SVD with norm-preserving projection and is well-tested.

| Situation | Recommended Method | Why |

|:----------------------------------|:-------------------|:-----------------------------------------|

| Default / most models | advanced | Multi-direction SVD, norm-preserving, reliable |

| Quick test / prototyping | basic | Fast, simple, good enough to evaluate |

| Dense model (Llama, Mistral) | advanced | Multi-direction, norm-preserving |

| MoE model (DeepSeek, Mixtral) | nuclear | Expert-granular, handles MoE complexity |

| Reasoning model (R1 distills) | surgical | CoT-aware, preserves chain-of-thought |

| Stubborn refusals persist | aggressive | Whitened SVD + head surgery + jailbreak |

| Want reversible changes | Use steering vectors (see Analysis section) |

| Maximum quality, time no object | optimized | Bayesian search for best parameters |

| Experimental auto-detection | informed | Auto-detects alignment type — experimental, may not always outperform advanced |

9 CLI Methods

• basic — Single refusal direction via diff-in-means. Fast (~5-10 min for 8B).
• advanced (DEFAULT, RECOMMENDED) — Multiple SVD directions, norm-preserving projection, 2 refinement passes. Medium speed (~10-20 min).
• aggressive — Whitened SVD + jailbreak-contrastive + attention head surgery. Higher risk of coherence damage.
• spectral_cascade — DCT frequency-domain decomposition. Research/novel approach.
• informed — Runs analysis DURING abliteration to auto-configure. Experimental — slower and less predictable than advanced.
• surgical — SAE features + neuron masking + head surgery + per-expert. Very slow (~1-2 hrs). Best for reasoning models.
• optimized — Bayesian hyperparameter search (Optuna TPE). Longest runtime but finds optimal parameters.
• inverted — Flips the refusal direction. Model becomes actively willing.
• nuclear — Maximum force combo for stubborn MoE models. Expert-granular.

Direction Extraction Methods (--direction-method flag)

• diff_means (default) — Simple difference-in-means between refused/complied activations. Robust.
• svd — Multi-direction SVD extraction. Better for complex alignment.
• leace — LEACE (Linear Erasure via Closed-form Estimation). Optimal linear erasure.

4 Python-API-Only Methods

(NOT available via CLI — require Python import, which violates AGPL boundary. Mention to user only if they explicitly want to use OBLITERATUS as a library in their own AGPL project.)

• failspy, gabliteration, heretic, rdo

Step 5: Run Abliteration

Standard usage

# Default method (advanced) — recommended for most models
obliteratus obliterate <model_name> --method advanced --output-dir ./abliterated-models

# With 4-bit quantization (saves VRAM)
obliteratus obliterate <model_name> --method advanced --quantization 4bit --output-dir ./abliterated-models

# Large models (70B+) — conservative defaults
obliteratus obliterate <model_name> --method advanced --quantization 4bit --large-model --output-dir ./abliterated-models

Fine-tuning parameters

obliteratus obliterate <model_name> \
  --method advanced \
  --direction-method diff_means \
  --n-directions 4 \
  --refinement-passes 2 \
  --regularization 0.1 \
  --quantization 4bit \
  --output-dir ./abliterated-models \
  --contribute  # opt-in telemetry for community research

Key flags

| Flag | Description | Default |

|:-----|:------------|:--------|

| --method | Abliteration method | advanced |

| --direction-method | Direction extraction | diff_means |

| --n-directions | Number of refusal directions (1-32) | method-dependent |

| --refinement-passes | Iterative passes (1-5) | 2 |

| --regularization | Regularization strength (0.0-1.0) | 0.1 |

| --quantization | Load in 4bit or 8bit | none (full precision) |

| --large-model | Conservative defaults for 120B+ | false |

| --output-dir | Where to save the abliterated model | ./obliterated_model |

| --contribute | Share anonymized results for research | false |

| --verify-sample-size | Number of test prompts for refusal check | 20 |

| --dtype | Model dtype (float16, bfloat16) | auto |

Other execution modes

# Interactive guided mode (hardware → model → preset)
obliteratus interactive

# Web UI (Gradio)
obliteratus ui --port 7860

# Run a full ablation study from YAML config
obliteratus run config.yaml --preset quick

# Tournament: pit all methods against each other
obliteratus tourney <model_name>

Step 6: Verify Results

After abliteration, check the output metrics:

| Metric | Good Value | Warning |

|:-------|:-----------|:--------|

| Refusal rate | < 5% (ideally ~0%) | > 10% means refusals persist |

| Perplexity change | < 10% increase | > 15% means coherence damage |

| KL divergence | < 0.1 | > 0.5 means significant distribution shift |

| Coherence | High / passes qualitative check | Degraded responses, repetition |

If refusals persist (>

… (nội dung đầy đủ có trong gói tải về)